Jul 17 06:55:43 devstack cinder-volume[76268]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 06:55:43 devstack cinder-volume[76268]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 06:55:43 devstack cinder-volume[76268]: we strongly recommend against using it for new projects. Jul 17 06:55:43 devstack cinder-volume[76268]: If you are already using Eventlet, we recommend migrating to a different Jul 17 06:55:43 devstack cinder-volume[76268]: framework. For more detail see Jul 17 06:55:43 devstack cinder-volume[76268]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 06:55:43 devstack cinder-volume[76268]: import eventlet # noqa Jul 17 06:55:46 devstack cinder-volume[76268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 06:55:46 devstack cinder-volume[76268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 06:55:46 devstack cinder-volume[76268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 06:55:47 devstack cinder-volume[76268]: INFO dbcounter [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Registered counter for database cinder Jul 17 06:55:47 devstack cinder-volume[76268]: DEBUG oslo_db.sqlalchemy.engines [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 06:55:47 devstack cinder-volume[76268]: DEBUG dbcounter [-] [76268] Writer thread running {{(pid=76268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 06:55:47 devstack cinder-volume[76268]: INFO cinder.rpc [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 06:55:47 devstack cinder-volume[76268]: INFO cinder.rpc [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 06:55:47 devstack cinder-volume[76268]: DEBUG oslo_db.sqlalchemy.engines [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 06:55:47 devstack cinder-volume[76268]: INFO cinder.volume.manager [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Determined volume DB was empty at startup. Jul 17 06:55:47 devstack cinder-volume[76268]: DEBUG cinder.volume.manager [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76268) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 06:55:47 devstack cinder-volume[76268]: INFO cinder.volume.manager [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 06:55:47 devstack cinder-volume[76268]: WARNING stevedore.named [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 06:55:47 devstack cinder-volume[76268]: WARNING castellan.key_manager [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 06:55:47 devstack cinder-volume[76268]: WARNING cinder.keymgr.conf_key_mgr [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 06:55:47 devstack cinder-volume[76268]: DEBUG cinder.volume.drivers.lvm [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76268) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 17 06:55:47 devstack cinder-volume[76268]: DEBUG oslo_concurrency.processutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76268) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_concurrency.processutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] CMD "cinder-rtstool verify" returned: 0 in 0.403s {{(pid=76268) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_db.sqlalchemy.engines [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 06:55:48 devstack cinder-volume[76268]: INFO cinder.rpc [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 17 06:55:48 devstack cinder-volume[76268]: INFO cinder.rpc [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 17 06:55:48 devstack cinder-volume[76268]: WARNING stevedore.named [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 06:55:48 devstack cinder-volume[76268]: WARNING castellan.key_manager [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 06:55:48 devstack cinder-volume[76268]: INFO cinder.volume.manager [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_db.sqlalchemy.engines [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 06:55:48 devstack cinder-volume[76268]: INFO oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Starting 1 workers Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Started child 76421 {{(pid=76268) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Full set of CONF: {{(pid=76268) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] ******************************************************************************** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Configuration options gathered from: {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 06:55:48 devstack cinder-volume[76421]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] ================================================================================ {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] allow_availability_zone_fallback = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] allow_compression_on_image_upload = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] allowed_direct_url_schemes = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] api_rate_limit = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] auth_strategy = keystone {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] az_cache_duration = 3600 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_availability_zone = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_host = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_stats_polling_interval = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backup_api_class = cinder.backup.api.API {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backup_name_template = backup-%s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backup_use_same_host = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backup_use_temp_snapshot = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] chap_password = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] chap_username = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_internal_tenant_project_id = f0ff38cfa15c49b9932045e2b5a45d09 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_internal_tenant_user_id = 07fc19f6c95b467695c0375a7566c8fe {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cloned_volume_same_az = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cluster = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] compression_format = gzip {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] compute_api_class = cinder.compute.nova.API {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] config_dir = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] config_source = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] control_exchange = openstack {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] debug = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] default_availability_zone = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] default_group_type = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] default_volume_type = lvmdriver-1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] disk_geometry = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] driver_client_cert = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] driver_client_cert_key = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] driver_data_namespace = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] driver_ssl_cert_path = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] driver_ssl_cert_verify = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] driver_use_ssl = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] enable_force_upload = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] enable_new_services = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] enable_unsupported_driver = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] enforce_multipath_for_image_xfer = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] filter_function = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_api_insecure = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_api_ssl_compression = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_ca_certificates_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_catalog_info = image:glance:publicURL {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_num_retries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance_request_timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] goodness_function = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] graceful_shutdown_timeout = 5 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] group_api_class = cinder.group.api.API {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] host = devstack {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_compress_on_upload = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_conversion_address_space_limit = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_conversion_cpu_limit = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_conversion_disable = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_upload_use_cinder_backend = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_upload_use_internal_tenant = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_volume_cache_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_volume_cache_max_count = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] image_volume_cache_max_size_gb = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] init_host_max_objects_retrieval = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] instance_format = [instance: %(uuid)s] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76421]: INFO cinder.volume.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] iscsi_target_flags = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] iscsi_write_cache = on {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] iser_helper = tgtadm {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] iser_ip_address = 192.168.122.176 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] iser_port = 3260 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_color = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_config_append = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_dir = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_options = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_rotate_interval = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_rotate_interval_type = days {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] log_rotation_type = none {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] max_age = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] max_logfile_count = 30 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] max_logfile_size_mb = 200 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] max_over_subscription_ratio = 20.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] message_reap_interval = 86400 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] message_ttl = 2592000 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] migration_create_volume_timeout_secs = 300 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] monkey_patch = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] monkey_patch_modules = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] my_ip = 192.168.122.176 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] no_snapshot_gb_quota = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] num_iser_scan_tries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] num_shell_tries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] num_volume_device_scan_tries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] nvmeof_conn_info_version = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] nvmet_ns_id = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] nvmet_port_id = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_max_limit = 1000 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_volume_ext_list = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_volume_listen_port = 8776 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_volume_use_ssl = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] osapi_volume_workers = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] per_volume_size_limit = -1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] periodic_fuzzy_delay = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] periodic_interval = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] public_endpoint = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] publish_errors = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_backup_gigabytes = 1000 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_backups = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_gigabytes = 1000 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_groups = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_snapshots = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] quota_volumes = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] rate_limit_burst = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] rate_limit_except_level = CRITICAL {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] rate_limit_interval = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] reinit_driver_count = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] replication_device = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] report_discard_supported = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] report_interval = 120 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] reservation_clean_interval = 86400 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] reservation_expire = 86400 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] reserved_image_namespaces = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] reserved_percentage = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] rpc_response_timeout = 120 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] run_external_periodic_tasks = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] scst_target_driver = iscsi {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] scst_target_iqn_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_down_time = 720 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] shell_completion = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] snapshot_name_template = snapshot-%s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] snapshot_same_host = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] split_loggers = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] state_path = /opt/stack/data/cinder {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] storage_availability_zone = nova {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] storage_protocol = iSCSI {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] syslog_log_facility = LOG_USER {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] target_helper = lioadm {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] target_ip_address = 192.168.122.176 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] target_port = 3260 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] target_protocol = iscsi {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] target_secondary_ip_addresses = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] trace_flags = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] transport_url = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] until_refresh = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_chap_auth = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_default_quota_class = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_journal = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_json = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_multipath_for_image_xfer = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_stderr = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] use_syslog = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] verify_glance_signatures = enabled {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_api_class = cinder.volume.api.API {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_backend_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_clear = zero {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_clear_ionice = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_clear_size = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_copy_bps_limit = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_dd_blocksize = 1M {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_name_template = volume-%s {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_service_inithost_offload = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volume_usage_audit_period = month {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] zoning_mode = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_concurrency.disable_process_locking = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.auth_section = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.auth_type = password {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.auth_version = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.cache = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.include_service_catalog = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.insecure = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.interface = public {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_password = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcache_username = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.region_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.service_type = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.backend = dogpile.cache.null {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.backend_argument = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.backend_expiration_time = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.config_prefix = cache.oslo {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.debug_cache_backend = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.enable_retry_client = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.enable_socket_keepalive = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.expiration_time = 600 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.hashclient_retry_attempts = 2 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_dead_retry = 300 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_pool_maxsize = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_sasl_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.password = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.proxies = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.redis_db = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 17 06:55:48 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:48 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.redis_server = localhost:6379 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.retry_attempts = 2 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.retry_delay = 0.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.socket_keepalive_count = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.socket_keepalive_idle = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.socket_keepalive_interval = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.socket_timeout = 1.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.tls_allowed_ciphers = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.tls_cafile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.tls_certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.tls_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.tls_keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cache.username = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] coordination.backend_url = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.asyncio_connection = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.asyncio_slave_connection = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.backend = sqlalchemy {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.connection = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.connection_debug = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.connection_parameters = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.connection_recycle_time = 3600 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.connection_trace = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.db_inc_retry_interval = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.db_max_retries = 20 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.db_max_retry_interval = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.db_retry_interval = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.max_overflow = 50 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.max_pool_size = 5 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.max_retries = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.mysql_wsrep_sync_wait = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.pool_timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.retry_interval = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.slave_connection = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.sqlite_synchronous = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.synchronous_reader = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] database.use_db_reconnect = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.connection_string = messaging:// {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.es_doc_type = notification {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.es_scroll_size = 10000 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.es_scroll_time = 2m {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.filter_error_trace = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.hmac_keys = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.sentinel_service_name = mymaster {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.socket_timeout = 0.1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.trace_requests = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler.trace_sqlalchemy = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler_jaeger.process_tags = {} {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler_jaeger.service_name_prefix = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] profiler_otlp.service_name_prefix = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.enforce_new_defaults = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.policy_default_rule = default {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.policy_file = policy.yaml {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.group = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.helper_command = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] privsep_osbrick.user = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.group = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.helper_command = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] cinder_sys_admin.user = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.auth_section = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.auth_type = password {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.cafile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.collect_timing = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.insecure = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.send_service_user_token = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.split_loggers = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] service_user.timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.auth_section = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.auth_type = password {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.collect_timing = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.insecure = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.region_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.split_loggers = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] glance.timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.backend_availability_zone = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.chap_password = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.chap_username = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.disk_geometry = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.driver_client_cert = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.driver_client_cert_key = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.driver_data_namespace = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.driver_use_ssl = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.extra_capabilities = {} {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.filter_function = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.goodness_function = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.iscsi_target_flags = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.iscsi_write_cache = on {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.iser_helper = tgtadm {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.iser_port = 3260 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.lvm_share_target = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.lvm_type = auto {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.num_shell_tries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.replication_device = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.report_discard_supported = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.reserved_percentage = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.target_helper = tgtadm {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.target_port = 3260 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.target_protocol = iscsi {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.trace_flags = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.unique_fqdn_network = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.use_chap_auth = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_backend_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_clear = zero {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_clear_ionice = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_clear_size = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_reports.file_event_handler = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_reports.log_dir = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.backend_host = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.chap_password = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.chap_username = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.disk_geometry = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.driver_client_cert = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.extra_capabilities = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.filter_function = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.goodness_function = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.iser_helper = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.iser_ip_address = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.iser_port = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.lvm_share_target = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.lvm_type = auto {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.num_shell_tries = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.replication_device = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.report_discard_supported = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.reserved_percentage = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.scst_target_driver = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.storage_protocol = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.target_helper = lioadm {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.target_ip_address = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.target_port = 3260 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.trace_flags = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.use_chap_auth = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_clear = zero {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_clear_size = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] lvmdriver-1.volumes_dir = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_notifications.driver = [] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_notifications.retry = -1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] key_manager.fixed_key = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.barbican_api_version = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.barbican_endpoint = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.barbican_endpoint_type = public {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.barbican_region_name = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.cafile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.collect_timing = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.insecure = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.number_of_retries = 60 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.retry_delay = 1 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.send_service_user_token = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.split_loggers = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.verify_ssl = True {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican.verify_ssl_path = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.auth_section = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.auth_type = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.cafile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.certfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.collect_timing = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.insecure = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.keyfile = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.split_loggers = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] barbican_service_user.timeout = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.approle_role_id = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.approle_secret_id = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.auth_method = approle {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.auth_path = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.kv_mountpoint = secret {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.kv_path = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.kv_version = 2 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.namespace = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.root_token_id = **** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.ssl_ca_crt_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.timeout = 60.0 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.token_file = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.token_role = None {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.use_ssl = False {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 06:55:48 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] ******************************************************************************** {{(pid=76268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 06:55:49 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.400s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:49 devstack sudo[76573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:49 devstack sudo[76573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:49 devstack sudo[76573]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.280s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 06:55:49 devstack cinder-volume[76421]: INFO cinder.brick.local_dev.lvm [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:49 devstack sudo[76656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:55:49 devstack sudo[76656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:49 devstack sudo[76656]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG cinder.brick.local_dev.lvm [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76421) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 17 06:55:49 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:49 devstack sudo[76761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:49 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:50 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:50 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:50 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:50 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:50 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 17 06:55:50 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:50 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:50 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:50 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:55:50 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:51 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:51 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.357s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:51 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:51 devstack sudo[77154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:55:51 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:51 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:51 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:51 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:51 devstack sudo[77165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:51 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:51 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:51 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:51 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:51 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:51 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:52 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:52 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:52 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:52 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:52 devstack cinder-volume[76421]: INFO cinder.volume.drivers.lvm [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:52 devstack sudo[77256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:52 devstack sudo[77256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:52 devstack sudo[77256]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:52 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:55:52 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:52 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:52 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:52 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:53 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:53 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:53 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:53 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:53 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:53 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:53 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:53 devstack cinder-volume[76421]: INFO cinder.volume.driver [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG cinder.volume.driver [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76421) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_db.sqlalchemy.engines [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writer thread running {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG cinder.db.api [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Building query based on filter {{(pid=76421) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG cinder.image.image_utils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76421) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 06:55:53 devstack cinder-volume[76421]: INFO cinder.keymgr.migration [None req-da40c812-b919-4b93-9988-be5e36fa88f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:55:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:53 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:55:53 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:54 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:54 devstack sudo[77282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:54 devstack sudo[77282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:54 devstack sudo[77282]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:54 devstack sudo[77286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:54 devstack sudo[77286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:54 devstack sudo[77286]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:54 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:54 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:54 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:54 devstack cinder-volume[76421]: DEBUG cinder.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Notifying Schedulers of capabilities ... {{(pid=76421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 06:55:54 devstack cinder-volume[76421]: INFO cinder.volume.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Driver initialization completed successfully. Jul 17 06:55:54 devstack cinder-volume[76421]: INFO cinder.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Initiating service 2 cleanup Jul 17 06:55:55 devstack cinder-volume[76421]: INFO cinder.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Service 2 cleanup completed. Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG cinder.service [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Creating RPC server for service cinder-volume {{(pid=76421) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG cinder.service [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76421) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 06:55:55 devstack cinder-volume[76421]: INFO cinder.volume.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:55 devstack sudo[77295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:55:55 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:55 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:55 devstack sudo[77298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:55 devstack sudo[77298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:55 devstack sudo[77298]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:55 devstack sudo[77301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:55:55 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:55 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:55 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:55:55 devstack sudo[77304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:55:55 devstack sudo[77304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:55:56 devstack sudo[77304]: pam_unix(sudo:session): session closed for user root Jul 17 06:55:56 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:55:56 devstack cinder-volume[76421]: INFO cinder.volume.manager [None req-1dcfed23-66a9-42f4-b3f1-08956dc47bc1 None None] Driver post RPC initialization completed successfully. Jul 17 06:55:58 devstack cinder-volume[76268]: DEBUG dbcounter [-] [76268] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 06:56:05 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 06:56:06 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG oslo_service.periodic_task [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:56:52 devstack sudo[79280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:56:52 devstack sudo[79280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:56:52 devstack sudo[79280]: pam_unix(sudo:session): session closed for user root Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:56:52 devstack sudo[79283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:56:52 devstack sudo[79283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:56:52 devstack sudo[79283]: pam_unix(sudo:session): session closed for user root Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:56:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:56:52 devstack sudo[79286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:56:52 devstack sudo[79286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:56:53 devstack sudo[79286]: pam_unix(sudo:session): session closed for user root Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:56:53 devstack sudo[79289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:56:53 devstack sudo[79289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:56:53 devstack sudo[79289]: pam_unix(sudo:session): session closed for user root Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG cinder.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Notifying Schedulers of capabilities ... {{(pid=76421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG oslo_service.periodic_task [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running periodic task VolumeManager._thread_info {{(pid=76421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG cinder.volume.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] thread count: 6 {{(pid=76421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 06:56:53 devstack cinder-volume[76421]: DEBUG cinder.volume.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] thread info: [<_MainThread(MainThread, started 133921132408960)>, , , , , ] {{(pid=76421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG oslo_service.periodic_task [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:57:52 devstack sudo[82596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:57:52 devstack sudo[82596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:57:52 devstack sudo[82596]: pam_unix(sudo:session): session closed for user root Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:57:52 devstack sudo[82599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:57:52 devstack sudo[82599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:57:52 devstack sudo[82599]: pam_unix(sudo:session): session closed for user root Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:57:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:57:52 devstack sudo[82603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:57:52 devstack sudo[82603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:57:53 devstack sudo[82603]: pam_unix(sudo:session): session closed for user root Jul 17 06:57:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:57:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:57:53 devstack sudo[82610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:57:53 devstack sudo[82610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:57:53 devstack sudo[82610]: pam_unix(sudo:session): session closed for user root Jul 17 06:57:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:57:53 devstack cinder-volume[76421]: DEBUG cinder.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Notifying Schedulers of capabilities ... {{(pid=76421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 06:58:06 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writing DB stats cinder:SELECT=1 {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 06:58:06 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writing DB stats cinder:UPDATE=1 {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG oslo_service.periodic_task [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:58:52 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:58:52 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:58:52 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:58:52 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:58:52 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:58:52 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:58:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:58:52 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:58:52 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:58:53 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:58:53 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:58:53 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:58:53 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG cinder.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Notifying Schedulers of capabilities ... {{(pid=76421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG oslo_service.periodic_task [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running periodic task VolumeManager._thread_info {{(pid=76421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG cinder.volume.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] thread count: 6 {{(pid=76421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 06:58:53 devstack cinder-volume[76421]: DEBUG cinder.volume.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] thread info: [<_MainThread(MainThread, started 133921132408960)>, , , , , ] {{(pid=76421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG oslo_service.periodic_task [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG cinder.volume.drivers.lvm [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Updating volume stats {{(pid=76421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:59:52 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 17 06:59:52 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:59:52 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:59:52 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:59:52 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:59:52 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:59:52 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:59:52 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 17 06:59:52 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:59:53 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Jul 17 06:59:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:59:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 06:59:53 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 17 06:59:53 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 06:59:53 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Jul 17 06:59:53 devstack cinder-volume[76421]: DEBUG oslo_concurrency.processutils [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 06:59:53 devstack cinder-volume[76421]: DEBUG cinder.manager [None req-61df224e-9a94-46ff-9ce2-1061c8f7616f None None] Notifying Schedulers of capabilities ... {{(pid=76421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:00:06 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writing DB stats cinder:SELECT=1 {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:00:06 devstack cinder-volume[76421]: DEBUG dbcounter [-] [76421] Writing DB stats cinder:UPDATE=1 {{(pid=76421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:00:14 devstack cinder-volume[76268]: INFO oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Caught SIGTERM, stopping children Jul 17 07:00:14 devstack cinder-volume[76268]: DEBUG oslo_concurrency.lockutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Acquiring lock "singleton_lock" {{(pid=76268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 07:00:14 devstack cinder-volume[76268]: DEBUG oslo_concurrency.lockutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Acquired lock "singleton_lock" {{(pid=76268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 07:00:14 devstack cinder-volume[76268]: DEBUG oslo_concurrency.lockutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Releasing lock "singleton_lock" {{(pid=76268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 07:00:14 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Stop services. {{(pid=76268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 07:00:14 devstack cinder-volume[76268]: DEBUG oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Killing children. {{(pid=76268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 07:00:14 devstack cinder-volume[76268]: INFO oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Waiting on 1 children to exit Jul 17 07:00:15 devstack cinder-volume[76421]: DEBUG oslo_concurrency.lockutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Acquiring lock "singleton_lock" {{(pid=76421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 07:00:15 devstack cinder-volume[76421]: DEBUG oslo_concurrency.lockutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Acquired lock "singleton_lock" {{(pid=76421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 07:00:15 devstack cinder-volume[76421]: DEBUG oslo_concurrency.lockutils [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Releasing lock "singleton_lock" {{(pid=76421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 07:00:15 devstack cinder-volume[76421]: WARNING amqp [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 07:00:15 devstack cinder-volume[76421]: WARNING amqp [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 07:00:15 devstack cinder-volume[76268]: INFO oslo_service.backend._eventlet.service [None req-50ecd746-ca68-4dc5-8cf6-8e356787cb68 None None] Child 76421 exited with status 0 Jul 17 07:00:15 devstack cinder-volume[86531]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 07:00:15 devstack cinder-volume[86531]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 07:00:15 devstack cinder-volume[86531]: we strongly recommend against using it for new projects. Jul 17 07:00:15 devstack cinder-volume[86531]: If you are already using Eventlet, we recommend migrating to a different Jul 17 07:00:15 devstack cinder-volume[86531]: framework. For more detail see Jul 17 07:00:15 devstack cinder-volume[86531]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 07:00:15 devstack cinder-volume[86531]: import eventlet # noqa Jul 17 07:00:17 devstack cinder-volume[86531]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 07:00:17 devstack cinder-volume[86531]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 07:00:17 devstack cinder-volume[86531]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 07:00:18 devstack cinder-volume[86531]: INFO dbcounter [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Registered counter for database cinder Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_db.sqlalchemy.engines [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG dbcounter [-] [86531] Writer thread running {{(pid=86531) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 07:00:18 devstack cinder-volume[86531]: INFO cinder.rpc [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 07:00:18 devstack cinder-volume[86531]: INFO cinder.rpc [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_db.sqlalchemy.engines [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:18 devstack cinder-volume[86531]: INFO cinder.volume.manager [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Determined volume DB was empty at startup. Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG cinder.volume.manager [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86531) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 07:00:18 devstack cinder-volume[86531]: INFO cinder.volume.manager [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 17 07:00:18 devstack cinder-volume[86531]: WARNING stevedore.named [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 07:00:18 devstack cinder-volume[86531]: WARNING castellan.key_manager [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 07:00:18 devstack cinder-volume[86531]: WARNING cinder.keymgr.conf_key_mgr [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 07:00:18 devstack cinder-volume[86531]: INFO cinder.volume.manager [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_db.sqlalchemy.engines [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86531) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:18 devstack cinder-volume[86531]: INFO oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Starting 1 workers Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Started child 86743 {{(pid=86531) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Full set of CONF: {{(pid=86531) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] ******************************************************************************** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Configuration options gathered from: {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] ================================================================================ {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] allow_availability_zone_fallback = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] allow_compression_on_image_upload = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] allowed_direct_url_schemes = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86743]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] api_rate_limit = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] auth_strategy = keystone {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_availability_zone = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_host = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_stats_polling_interval = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backup_api_class = cinder.backup.api.API {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backup_name_template = backup-%s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backup_use_same_host = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backup_use_temp_snapshot = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] chap_password = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] chap_username = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_internal_tenant_project_id = f0ff38cfa15c49b9932045e2b5a45d09 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_internal_tenant_user_id = 07fc19f6c95b467695c0375a7566c8fe {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cluster = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] compression_format = gzip {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] compute_api_class = cinder.compute.nova.API {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] config_dir = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] config_source = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] control_exchange = openstack {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] debug = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] default_availability_zone = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] default_group_type = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] default_volume_type = QuobyteHD {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] disk_geometry = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] driver_client_cert = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] driver_client_cert_key = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] driver_data_namespace = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] driver_ssl_cert_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] driver_ssl_cert_verify = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] driver_use_ssl = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] enable_new_services = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] enable_unsupported_driver = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] enabled_backends = ['QuobyteHD'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] enforce_multipath_for_image_xfer = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] filter_function = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_api_insecure = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_api_ssl_compression = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_ca_certificates_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_catalog_info = image:glance:publicURL {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_num_retries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance_request_timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] goodness_function = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] graceful_shutdown_timeout = 5 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] group_api_class = cinder.group.api.API {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:18 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] host = devstack {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_compress_on_upload = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_conversion_address_space_limit = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_conversion_cpu_limit = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_conversion_disable = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_upload_use_cinder_backend = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_upload_use_internal_tenant = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_volume_cache_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_volume_cache_max_count = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] image_volume_cache_max_size_gb = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] init_host_max_objects_retrieval = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] instance_format = [instance: %(uuid)s] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] iscsi_target_flags = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] iscsi_write_cache = on {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] iser_helper = tgtadm {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] iser_ip_address = 192.168.122.176 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] iser_port = 3260 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_color = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86743]: INFO cinder.volume.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Starting volume driver QuobyteDriver (1.2) Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.remotefs [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86743) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_config_append = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_dir = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_options = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_rotate_interval = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_rotate_interval_type = days {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] log_rotation_type = none {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] max_age = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] max_logfile_count = 30 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] max_logfile_size_mb = 200 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] max_over_subscription_ratio = 20.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] message_reap_interval = 86400 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] message_ttl = 2592000 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] migration_create_volume_timeout_secs = 300 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] monkey_patch = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] monkey_patch_modules = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] my_ip = 192.168.122.176 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] no_snapshot_gb_quota = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] num_iser_scan_tries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] num_shell_tries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] num_volume_device_scan_tries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] nvmeof_conn_info_version = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] nvmet_ns_id = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] nvmet_port_id = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_max_limit = 1000 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_volume_ext_list = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_volume_listen_port = 8776 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_volume_use_ssl = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] osapi_volume_workers = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] per_volume_size_limit = -1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] periodic_fuzzy_delay = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] periodic_interval = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] public_endpoint = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] publish_errors = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_backup_gigabytes = 1000 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_backups = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_gigabytes = 1000 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_groups = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_snapshots = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] quota_volumes = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] rate_limit_burst = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] rate_limit_except_level = CRITICAL {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] rate_limit_interval = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] reinit_driver_count = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] replication_device = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] report_discard_supported = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] report_interval = 120 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] reservation_clean_interval = 86400 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] reservation_expire = 86400 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] reserved_image_namespaces = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] reserved_percentage = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] rpc_response_timeout = 120 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] run_external_periodic_tasks = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] scst_target_driver = iscsi {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] scst_target_iqn_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_down_time = 720 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] shell_completion = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] snapshot_name_template = snapshot-%s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] split_loggers = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] state_path = /opt/stack/data/cinder {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] storage_availability_zone = nova {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] storage_protocol = iSCSI {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] syslog_log_facility = LOG_USER {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] target_helper = lioadm {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] target_ip_address = 192.168.122.176 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] target_port = 3260 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] target_protocol = iscsi {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] target_secondary_ip_addresses = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] trace_flags = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] transport_url = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] until_refresh = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_chap_auth = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_default_quota_class = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_journal = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_json = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_multipath_for_image_xfer = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_stderr = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] use_syslog = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] verify_glance_signatures = enabled {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_api_class = cinder.volume.api.API {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_backend_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_clear = zero {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_clear_ionice = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_clear_size = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_copy_bps_limit = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_dd_blocksize = 1M {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_name_template = volume-%s {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_service_inithost_offload = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volume_usage_audit_period = month {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] zoning_mode = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_concurrency.disable_process_locking = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.auth_section = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.auth_type = password {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.auth_version = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.cache = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.include_service_catalog = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.insecure = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.interface = public {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_password = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcache_username = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.region_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.service_type = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.backend = dogpile.cache.null {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.backend_argument = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.backend_expiration_time = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.config_prefix = cache.oslo {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.debug_cache_backend = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.enable_retry_client = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.enable_socket_keepalive = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.expiration_time = 600 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.hashclient_retry_attempts = 2 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_dead_retry = 300 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_pool_maxsize = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_sasl_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.password = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.proxies = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.redis_db = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.redis_server = localhost:6379 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.retry_attempts = 2 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.retry_delay = 0.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.socket_keepalive_count = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.socket_keepalive_idle = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.socket_keepalive_interval = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86743) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 07:00:19 devstack cinder-volume[86743]: WARNING cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 07:00:19 devstack cinder-volume[86743]: WARNING cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.socket_timeout = 1.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.tls_allowed_ciphers = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.tls_cafile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.tls_certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.tls_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.tls_keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cache.username = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] coordination.backend_url = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.asyncio_connection = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.asyncio_slave_connection = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.backend = sqlalchemy {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.connection = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.connection_debug = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.connection_parameters = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.connection_recycle_time = 3600 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.connection_trace = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.db_inc_retry_interval = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.db_max_retries = 20 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.db_max_retry_interval = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.db_retry_interval = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.max_overflow = 50 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.max_pool_size = 5 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.max_retries = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.mysql_wsrep_sync_wait = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.pool_timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.retry_interval = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.slave_connection = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.sqlite_synchronous = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.synchronous_reader = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] database.use_db_reconnect = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.connection_string = messaging:// {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.es_doc_type = notification {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.es_scroll_size = 10000 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.es_scroll_time = 2m {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.filter_error_trace = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.hmac_keys = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.sentinel_service_name = mymaster {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.socket_timeout = 0.1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.trace_requests = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler.trace_sqlalchemy = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler_jaeger.process_tags = {} {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler_jaeger.service_name_prefix = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] profiler_otlp.service_name_prefix = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.enforce_new_defaults = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.policy_default_rule = default {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.policy_file = policy.yaml {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.group = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.helper_command = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] privsep_osbrick.user = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.group = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.helper_command = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] cinder_sys_admin.user = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.auth_section = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.auth_type = password {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.cafile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.collect_timing = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.insecure = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.send_service_user_token = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.split_loggers = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] service_user.timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.auth_section = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.auth_type = password {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.collect_timing = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.insecure = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.region_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.split_loggers = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] glance.timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.backend_availability_zone = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.chap_password = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.chap_username = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.disk_geometry = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.driver_client_cert = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.driver_client_cert_key = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.driver_data_namespace = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.driver_use_ssl = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.extra_capabilities = {} {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.filter_function = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.goodness_function = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.iscsi_target_flags = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.iscsi_write_cache = on {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.iser_helper = tgtadm {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.iser_port = 3260 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_host = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_login = admin {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_mount_options = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_password = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_private_key = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_share_path = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.num_shell_tries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.quobyte_volume_url = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.replication_device = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.report_discard_supported = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack quobyte-client[86746]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 07:00:19 devstack quobyte-client[86746]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.reserved_percentage = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.target_helper = tgtadm {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.target_port = 3260 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.target_protocol = iscsi {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.trace_flags = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.unique_fqdn_network = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=86743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.use_chap_auth = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: INFO cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 ... Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_backend_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da -c /etc/quobyte/client-cinder.cfg {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_clear = zero {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_clear_ionice = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_clear_size = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_reports.file_event_handler = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_reports.log_dir = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.backend_availability_zone = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.backend_host = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.chap_password = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.chap_username = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.chiscsi_conf = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.disk_geometry = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.driver_client_cert = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.driver_data_namespace = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.driver_use_ssl = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.extra_capabilities = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.filter_function = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.goodness_function = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.iser_helper = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.iser_ip_address = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.iser_port = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.iser_target_prefix = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_host = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_login = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_mount_options = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_password = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_private_key = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_share_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_ssh_port = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.num_shell_tries = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.nvmet_port_id = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.replication_device = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.report_discard_supported = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.reserved_percentage = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.scst_target_driver = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.storage_protocol = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.target_helper = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.target_ip_address = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.target_port = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.target_prefix = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.target_protocol = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.trace_flags = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.use_chap_auth = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_clear = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_clear_size = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] QuobyteHD.volumes_dir = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da -c /etc/quobyte/client-cinder.cfg Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_notifications.driver = [] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_notifications.retry = -1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] key_manager.fixed_key = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.barbican_api_version = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.barbican_endpoint = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.barbican_endpoint_type = public {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.barbican_region_name = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.cafile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.collect_timing = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.insecure = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.number_of_retries = 60 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.retry_delay = 1 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.send_service_user_token = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.split_loggers = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.verify_ssl = True {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican.verify_ssl_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.auth_section = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.auth_type = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.cafile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.certfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.collect_timing = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.insecure = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.keyfile = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.split_loggers = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] barbican_service_user.timeout = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.approle_role_id = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.approle_secret_id = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.auth_method = approle {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.auth_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.kv_mountpoint = secret {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.kv_path = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.kv_version = 2 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.namespace = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.root_token_id = **** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.ssl_ca_crt_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.timeout = 60.0 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.token_file = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.token_role = None {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.use_ssl = False {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:19 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] ******************************************************************************** {{(pid=86531) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 07:00:19 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.411s {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:19 devstack cinder-volume[86743]: INFO cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 succeeded Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=86743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.424s {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:19 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:00:19 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:19 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.253s {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:19 devstack cinder-volume[86743]: INFO cinder.volume.driver [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Driver hasn't implemented _init_vendor_properties() Jul 17 07:00:19 devstack cinder-volume[86743]: DEBUG cinder.volume.driver [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86743) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_db.sqlalchemy.engines [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG dbcounter [-] [86743] Writer thread running {{(pid=86743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.db.api [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Building query based on filter {{(pid=86743) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.image.image_utils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86743) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 07:00:20 devstack cinder-volume[86743]: INFO cinder.keymgr.migration [None req-5a2425f7-1e40-4fa0-8d16-47af86ae9c48 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=86743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=86743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:20 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:00:20 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:20 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.229s {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Notifying Schedulers of capabilities ... {{(pid=86743) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:00:20 devstack cinder-volume[86743]: INFO cinder.volume.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Driver initialization completed successfully. Jul 17 07:00:20 devstack cinder-volume[86743]: INFO cinder.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Initiating service 3 cleanup Jul 17 07:00:20 devstack cinder-volume[86743]: INFO cinder.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Service 3 cleanup completed. Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.service [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Creating RPC server for service cinder-volume {{(pid=86743) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.service [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86743) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 07:00:20 devstack cinder-volume[86743]: INFO cinder.volume.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=86743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG cinder.volume.drivers.quobyte [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=86743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:20 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:00:20 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:20 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:20 devstack cinder-volume[86743]: DEBUG oslo_concurrency.processutils [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.240s {{(pid=86743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:20 devstack cinder-volume[86743]: INFO cinder.volume.manager [None req-525aba00-11e3-4012-a648-add5da1f3ae5 None None] Driver post RPC initialization completed successfully. Jul 17 07:00:25 devstack cinder-volume[86531]: INFO oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Caught SIGTERM, stopping children Jul 17 07:00:25 devstack cinder-volume[86531]: DEBUG oslo_concurrency.lockutils [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Acquiring lock "singleton_lock" {{(pid=86531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 07:00:25 devstack cinder-volume[86531]: DEBUG oslo_concurrency.lockutils [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Acquired lock "singleton_lock" {{(pid=86531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 07:00:25 devstack cinder-volume[86531]: DEBUG oslo_concurrency.lockutils [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Releasing lock "singleton_lock" {{(pid=86531) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 07:00:25 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Stop services. {{(pid=86531) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 17 07:00:25 devstack cinder-volume[86531]: DEBUG oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Killing children. {{(pid=86531) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 17 07:00:25 devstack cinder-volume[86531]: INFO oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Waiting on 1 children to exit Jul 17 07:00:28 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Acquiring lock "singleton_lock" {{(pid=86743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 07:00:28 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Acquired lock "singleton_lock" {{(pid=86743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 07:00:28 devstack cinder-volume[86743]: DEBUG oslo_concurrency.lockutils [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Releasing lock "singleton_lock" {{(pid=86743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 07:00:28 devstack cinder-volume[86743]: WARNING amqp [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 07:00:28 devstack cinder-volume[86743]: WARNING amqp [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 17 07:00:28 devstack cinder-volume[86531]: INFO oslo_service.backend._eventlet.service [None req-9de09e98-598f-4af2-a4d2-795c21e7971e None None] Child 86743 exited with status 0 Jul 17 07:00:29 devstack cinder-volume[87022]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 17 07:00:29 devstack cinder-volume[87022]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 07:00:29 devstack cinder-volume[87022]: we strongly recommend against using it for new projects. Jul 17 07:00:29 devstack cinder-volume[87022]: If you are already using Eventlet, we recommend migrating to a different Jul 17 07:00:29 devstack cinder-volume[87022]: framework. For more detail see Jul 17 07:00:29 devstack cinder-volume[87022]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 07:00:29 devstack cinder-volume[87022]: import eventlet # noqa Jul 17 07:00:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 17 07:00:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 17 07:00:32 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 17 07:00:32 devstack cinder-volume[87022]: INFO dbcounter [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Registered counter for database cinder Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_db.sqlalchemy.engines [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writer thread running {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 07:00:33 devstack cinder-volume[87022]: INFO cinder.rpc [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 17 07:00:33 devstack cinder-volume[87022]: INFO cinder.rpc [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_db.sqlalchemy.engines [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Determined volume DB was empty at startup. Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG cinder.volume.manager [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87022) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 17 07:00:33 devstack cinder-volume[87022]: WARNING stevedore.named [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 17 07:00:33 devstack cinder-volume[87022]: WARNING castellan.key_manager [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 07:00:33 devstack cinder-volume[87022]: WARNING cinder.keymgr.conf_key_mgr [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 17 07:00:33 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_db.sqlalchemy.engines [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:33 devstack cinder-volume[87022]: INFO oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Starting 1 workers Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Started child 87331 {{(pid=87022) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Full set of CONF: {{(pid=87022) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] ******************************************************************************** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] Configuration options gathered from: {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] ================================================================================ {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 17 07:00:33 devstack cinder-volume[87331]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] allow_availability_zone_fallback = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] allow_compression_on_image_upload = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] allowed_direct_url_schemes = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] api_rate_limit = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] auth_strategy = keystone {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_availability_zone = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_host = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_stats_polling_interval = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backup_api_class = cinder.backup.api.API {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backup_name_template = backup-%s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backup_use_same_host = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backup_use_temp_snapshot = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] chap_password = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] chap_username = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_internal_tenant_project_id = f0ff38cfa15c49b9932045e2b5a45d09 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_internal_tenant_user_id = 07fc19f6c95b467695c0375a7566c8fe {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cluster = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] compression_format = gzip {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] compute_api_class = cinder.compute.nova.API {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] config_dir = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] config_source = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] control_exchange = openstack {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] debug = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] default_availability_zone = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] default_group_type = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] default_volume_type = QuobyteHD {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] disk_geometry = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] driver_client_cert = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] driver_client_cert_key = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] driver_data_namespace = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] driver_ssl_cert_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] driver_ssl_cert_verify = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] driver_use_ssl = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] enable_new_services = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] enable_unsupported_driver = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] enabled_backends = ['QuobyteHD'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] enforce_multipath_for_image_xfer = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] filter_function = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_api_insecure = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_api_ssl_compression = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_ca_certificates_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_catalog_info = image:glance:publicURL {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_num_retries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance_request_timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] goodness_function = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] graceful_shutdown_timeout = 5 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] group_api_class = cinder.group.api.API {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] host = devstack {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_compress_on_upload = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_conversion_address_space_limit = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_conversion_cpu_limit = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_conversion_disable = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_upload_use_cinder_backend = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_upload_use_internal_tenant = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_volume_cache_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_volume_cache_max_count = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] image_volume_cache_max_size_gb = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Starting volume driver QuobyteDriver (1.2) Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] init_host_max_objects_retrieval = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87331) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] instance_format = [instance: %(uuid)s] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] iscsi_target_flags = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] iscsi_write_cache = on {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] iser_helper = tgtadm {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] iser_ip_address = 192.168.122.176 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] iser_port = 3260 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_color = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_config_append = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_dir = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_options = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_rotate_interval = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_rotate_interval_type = days {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] log_rotation_type = none {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] max_age = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] max_logfile_count = 30 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] max_logfile_size_mb = 200 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] max_over_subscription_ratio = 20.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] message_reap_interval = 86400 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] message_ttl = 2592000 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] migration_create_volume_timeout_secs = 300 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] monkey_patch = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] monkey_patch_modules = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] my_ip = 192.168.122.176 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] no_snapshot_gb_quota = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] num_iser_scan_tries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] num_shell_tries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] num_volume_device_scan_tries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] nvmeof_conn_info_version = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] nvmet_ns_id = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] nvmet_port_id = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_max_limit = 1000 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_volume_ext_list = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_volume_listen_port = 8776 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_volume_use_ssl = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] osapi_volume_workers = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] per_volume_size_limit = -1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] periodic_fuzzy_delay = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] periodic_interval = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] public_endpoint = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] publish_errors = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_backup_gigabytes = 1000 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_backups = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_gigabytes = 1000 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_groups = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_snapshots = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] quota_volumes = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] rate_limit_burst = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] rate_limit_except_level = CRITICAL {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] rate_limit_interval = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] reinit_driver_count = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] replication_device = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] report_discard_supported = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] report_interval = 120 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] reservation_clean_interval = 86400 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] reservation_expire = 86400 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] reserved_image_namespaces = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] reserved_percentage = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] rpc_response_timeout = 120 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] run_external_periodic_tasks = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] scst_target_driver = iscsi {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] scst_target_iqn_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_down_time = 720 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] shell_completion = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] snapshot_name_template = snapshot-%s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] split_loggers = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] state_path = /opt/stack/data/cinder {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] storage_availability_zone = nova {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] storage_protocol = iSCSI {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] syslog_log_facility = LOG_USER {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] target_helper = lioadm {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] target_ip_address = 192.168.122.176 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] target_port = 3260 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] target_protocol = iscsi {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] target_secondary_ip_addresses = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] trace_flags = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] transport_url = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] until_refresh = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_chap_auth = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_default_quota_class = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_journal = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_json = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_multipath_for_image_xfer = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_stderr = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] use_syslog = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] verify_glance_signatures = enabled {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_api_class = cinder.volume.api.API {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_backend_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_clear = zero {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_clear_ionice = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_clear_size = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_copy_bps_limit = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_dd_blocksize = 1M {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_name_template = volume-%s {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_service_inithost_offload = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volume_usage_audit_period = month {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] zoning_mode = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_concurrency.disable_process_locking = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.auth_section = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.auth_type = password {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.auth_version = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.cache = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87331) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 17 07:00:33 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Running cmd (subprocess): mount.quobyte {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.include_service_catalog = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.insecure = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.interface = public {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_password = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcache_username = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.region_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.service_type = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.backend = dogpile.cache.null {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.backend_argument = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.backend_expiration_time = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.config_prefix = cache.oslo {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.debug_cache_backend = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.enable_retry_client = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.enable_socket_keepalive = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.expiration_time = 600 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.hashclient_retry_attempts = 2 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_dead_retry = 300 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_pool_maxsize = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_sasl_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.password = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.proxies = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.redis_db = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.redis_server = localhost:6379 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.retry_attempts = 2 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.retry_delay = 0.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.socket_keepalive_count = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.socket_keepalive_idle = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.socket_keepalive_interval = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.socket_timeout = 1.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.tls_allowed_ciphers = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.tls_cafile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.tls_certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.tls_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.tls_keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cache.username = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] coordination.backend_url = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.asyncio_connection = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.asyncio_slave_connection = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.backend = sqlalchemy {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.connection = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.connection_debug = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.connection_parameters = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.connection_recycle_time = 3600 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.connection_trace = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.db_inc_retry_interval = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.db_max_retries = 20 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.db_max_retry_interval = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.db_retry_interval = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.max_overflow = 50 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.max_pool_size = 5 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.max_retries = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.mysql_wsrep_sync_wait = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.pool_timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.retry_interval = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.slave_connection = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.sqlite_synchronous = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.synchronous_reader = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] database.use_db_reconnect = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.connection_string = messaging:// {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.es_doc_type = notification {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.es_scroll_size = 10000 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.es_scroll_time = 2m {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.filter_error_trace = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.hmac_keys = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.sentinel_service_name = mymaster {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.socket_timeout = 0.1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.trace_requests = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler.trace_sqlalchemy = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler_jaeger.process_tags = {} {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler_jaeger.service_name_prefix = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] profiler_otlp.service_name_prefix = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.enforce_new_defaults = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack quobyte-client[87332]: Reading configuration file: /etc/quobyte/client.cfg Jul 17 07:00:33 devstack quobyte-client[87332]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.policy_default_rule = default {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.policy_file = policy.yaml {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.group = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.helper_command = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:00:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] privsep_osbrick.user = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.group = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.helper_command = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] cinder_sys_admin.user = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.auth_section = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.auth_type = password {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.cafile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.collect_timing = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.insecure = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.send_service_user_token = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.split_loggers = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] service_user.timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.auth_section = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.auth_type = password {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.collect_timing = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.insecure = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.region_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.split_loggers = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] glance.timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.backend_availability_zone = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.chap_password = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.chap_username = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.disk_geometry = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.driver_client_cert = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.driver_client_cert_key = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.driver_data_namespace = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.driver_use_ssl = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.extra_capabilities = {} {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.filter_function = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.goodness_function = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.iscsi_target_flags = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.iscsi_write_cache = on {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.iser_helper = tgtadm {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.iser_port = 3260 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_host = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_login = admin {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_mount_options = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_password = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_private_key = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_share_path = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.num_shell_tries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.quobyte_volume_url = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.replication_device = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.report_discard_supported = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.reserved_percentage = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.target_helper = tgtadm {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.target_port = 3260 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.target_protocol = iscsi {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.trace_flags = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.unique_fqdn_network = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.use_chap_auth = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_backend_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_clear = zero {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_clear_ionice = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_clear_size = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_reports.file_event_handler = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_reports.log_dir = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.backend_availability_zone = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.backend_host = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.chap_password = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.chap_username = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.chiscsi_conf = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.disk_geometry = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.driver_client_cert = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.driver_data_namespace = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.driver_use_ssl = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.extra_capabilities = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.filter_function = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.goodness_function = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.iser_helper = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.iser_ip_address = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.iser_port = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.iser_target_prefix = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_host = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_login = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_mount_options = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_password = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_private_key = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_share_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_ssh_port = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.num_shell_tries = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.nvmet_port_id = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.replication_device = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.report_discard_supported = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.reserved_percentage = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.scst_target_driver = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.storage_protocol = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.target_helper = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.target_ip_address = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.target_port = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.target_prefix = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.target_protocol = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.trace_flags = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.use_chap_auth = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_clear = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_clear_size = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] QuobyteHD.volumes_dir = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_notifications.driver = [] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_notifications.retry = -1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] key_manager.fixed_key = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.barbican_api_version = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.barbican_endpoint = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.barbican_endpoint_type = public {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.barbican_region_name = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.cafile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.collect_timing = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.insecure = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.number_of_retries = 60 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.retry_delay = 1 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.send_service_user_token = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.split_loggers = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.verify_ssl = True {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican.verify_ssl_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.auth_section = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.auth_type = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.cafile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.certfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.collect_timing = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.insecure = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.keyfile = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.split_loggers = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] barbican_service_user.timeout = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.approle_role_id = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.approle_secret_id = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.auth_method = approle {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.auth_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.kv_mountpoint = secret {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.kv_path = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.kv_version = 2 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.namespace = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.root_token_id = **** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.ssl_ca_crt_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.timeout = 60.0 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.token_file = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.token_role = None {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.use_ssl = False {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 17 07:00:33 devstack cinder-volume[87022]: DEBUG oslo_service.backend._eventlet.service [None req-64ab997b-c731-427f-ab3e-9e94e7b38c55 None None] ******************************************************************************** {{(pid=87022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 17 07:00:34 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.273s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.volume.driver [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Driver hasn't implemented _init_vendor_properties() Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.volume.driver [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87331) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_db.sqlalchemy.engines [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87331) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writer thread running {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.db.api [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Building query based on filter {{(pid=87331) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87331) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.keymgr.migration [None req-d40251e4-5c80-4695-aca3-bce5196eea55 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 17 07:00:34 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:00:34 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:34 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.230s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Driver initialization completed successfully. Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Initiating service 3 cleanup Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Service 3 cleanup completed. Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.service [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Creating RPC server for service cinder-volume {{(pid=87331) start /opt/stack/cinder/cinder/service.py:231}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.service [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87331) start /opt/stack/cinder/cinder/service.py:237}} Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:00:34 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:00:34 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:00:34 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Jul 17 07:00:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.240s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:00:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4e13a497-ff90-462d-99ed-88817630a30c None None] Driver post RPC initialization completed successfully. Jul 17 07:00:43 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:00:44 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:00:44 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=3 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:01:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:01:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 6 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:01:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Flow 'volume_create_manager' (8ccc7890-d245-4629-92c3-2ad134729e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ac95a3-a728-4b3b-b1fc-b985e14efa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ac95a3-a728-4b3b-b1fc-b985e14efa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1645524146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbc8373-2c87-4df4-93b6-8216136c16f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af6e792c42417eb369cb04260318f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:01:56Z,use_quota=True,user_id='57817d1e26ae4c5ca12db97dbe53ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7b8d5b-85f5-4ecb-a45c-d47661bd0960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7b8d5b-85f5-4ecb-a45c-d47661bd0960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67ed1f6-3cf7-46e1-ba72-e160ee8a9498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67ed1f6-3cf7-46e1-ba72-e160ee8a9498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbc8373-2c87-4df4-93b6-8216136c16f1', 'volume_name': 'volume-5dbc8373-2c87-4df4-93b6-8216136c16f1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851a2cd3-fc38-4c85-9156-00c5f4c2d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851a2cd3-fc38-4c85-9156-00c5f4c2d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a0fba2-ea54-40c0-868e-a7483127ae37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:01:56 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Volume 5dbc8373-2c87-4df4-93b6-8216136c16f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbc8373-2c87-4df4-93b6-8216136c16f1', 'volume_size': 1} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1645524146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbc8373-2c87-4df4-93b6-8216136c16f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af6e792c42417eb369cb04260318f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:01:56Z,use_quota=True,user_id='57817d1e26ae4c5ca12db97dbe53ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Creating volume 5dbc8373-2c87-4df4-93b6-8216136c16f1 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:01:56 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:01:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:01:56 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 1073741824 Jul 17 07:01:56 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:01:57 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Jul 17 07:01:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 1073741824" returned: 0 in 1.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:01:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:01:58 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 Jul 17 07:01:58 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:01:58 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1" returned: 0 in 0.604s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a0fba2-ea54-40c0-868e-a7483127ae37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbc8373-2c87-4df4-93b6-8216136c16f1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202adf5e-7fe8-4bcb-a44d-25b5783c448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:01:58 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Volume volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 (5dbc8373-2c87-4df4-93b6-8216136c16f1): created successfully Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202adf5e-7fe8-4bcb-a44d-25b5783c448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:01:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Flow 'volume_create_manager' (8ccc7890-d245-4629-92c3-2ad134729e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:01:58 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b4e7a6bd-cc34-4c0b-8bb2-8e50f57a18a1 tempest-VolumesAdminNegativeTest-681372038 None] Created volume successfully. Jul 17 07:02:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Acquiring lock "cinder-5dbc8373-2c87-4df4-93b6-8216136c16f1-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:02:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Lock "cinder-5dbc8373-2c87-4df4-93b6-8216136c16f1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:02:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Acquiring lock "cinder-quobyte-5dbc8373-2c87-4df4-93b6-8216136c16f1" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:02:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Lock "cinder-quobyte-5dbc8373-2c87-4df4-93b6-8216136c16f1" acquired by "delete_volume" :: waited 0.079s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:02:01 devstack cinder-volume[87331]: INFO oslo.privsep.daemon [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprb41zumk/privsep.sock'] Jul 17 07:02:01 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprb41zumk/privsep.sock Jul 17 07:02:01 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: Jul 17 07:02:03 devstack cinder-volume[87331]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 17 07:02:03 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:03 devstack cinder-volume[87331]: INFO oslo.privsep.daemon [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Spawned new privsep daemon via rootwrap Jul 17 07:02:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Accepted privsep connection to /tmp/tmprb41zumk/privsep.sock {{(pid=87331) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 17 07:02:03 devstack cinder-volume[87331]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 17 07:02:03 devstack cinder-volume[87331]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 17 07:02:03 devstack cinder-volume[87331]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 17 07:02:03 devstack cinder-volume[87331]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88551 Jul 17 07:02:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b76b20-973a-4601-b76e-208a60317060]: (2,) {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:02:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c16603-c060-42b3-8c73-695f798b2152]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:02:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:04 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 Jul 17 07:02:04 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:04 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1" returned: 0 in 0.813s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:04 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1 Jul 17 07:02:04 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:05 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5dbc8373-2c87-4df4-93b6-8216136c16f1" returned: 0 in 0.656s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Lock "cinder-quobyte-5dbc8373-2c87-4df4-93b6-8216136c16f1" released by "delete_volume" :: held 4.157s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:02:05 devstack cinder-volume[87331]: WARNING cinder.quota [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:02:05 devstack cinder-volume[87331]: WARNING cinder.quota [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Created reservations ['546510ec-0dd4-47db-8b0f-e2f0bb260d79', 'de44de3c-bf8a-476e-b536-14df21827546', '2c771186-8a94-4d14-97b9-c1dfcacb22b1', 'e801443e-73eb-4d4f-b6a2-80634615c440'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:06 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:02:06 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:06 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:06 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:02:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Deleted volume successfully. Jul 17 07:02:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2db1631-2e52-42b0-8ef6-3f9861c620ef tempest-VolumesAdminNegativeTest-681372038 None] Lock "cinder-5dbc8373-2c87-4df4-93b6-8216136c16f1-delete_volume" released by "delete_volume" :: held 5.488s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Flow 'volume_create_manager' (2f9f75ba-8f23-4df3-b18f-be77ac4a2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69c6197-183c-4142-b7eb-f1a76fdd94c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69c6197-183c-4142-b7eb-f1a76fdd94c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1980412403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d343f312-f37b-4cdb-9cdb-999f84eecf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e94645fe4441beba503fa5e6062027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:02:09Z,use_quota=True,user_id='c94d898763b9455ab4082e63d6f3d7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b849d7d0-701b-4825-9df6-d827e1fef505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b849d7d0-701b-4825-9df6-d827e1fef505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5892c98-e28f-44eb-b46d-c4abd72e2475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5892c98-e28f-44eb-b46d-c4abd72e2475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd343f312-f37b-4cdb-9cdb-999f84eecf12', 'volume_name': 'volume-d343f312-f37b-4cdb-9cdb-999f84eecf12', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd60d25-74cc-4c1c-ba25-d20419c628aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd60d25-74cc-4c1c-ba25-d20419c628aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4d2ddf-d4cb-4bd3-b129-7491f1743d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Volume d343f312-f37b-4cdb-9cdb-999f84eecf12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d343f312-f37b-4cdb-9cdb-999f84eecf12', 'volume_size': 1} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1980412403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d343f312-f37b-4cdb-9cdb-999f84eecf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e94645fe4441beba503fa5e6062027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:02:09Z,use_quota=True,user_id='c94d898763b9455ab4082e63d6f3d7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Creating volume d343f312-f37b-4cdb-9cdb-999f84eecf12 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:02:09 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:02:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:09 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 1073741824 Jul 17 07:02:09 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:10 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 1073741824" returned: 0 in 0.604s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:10 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 Jul 17 07:02:10 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:10 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12" returned: 0 in 0.302s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4d2ddf-d4cb-4bd3-b129-7491f1743d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d343f312-f37b-4cdb-9cdb-999f84eecf12', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef04ac6-d8ae-466d-b540-32f605416f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Volume volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 (d343f312-f37b-4cdb-9cdb-999f84eecf12): created successfully Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef04ac6-d8ae-466d-b540-32f605416f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Flow 'volume_create_manager' (2f9f75ba-8f23-4df3-b18f-be77ac4a2417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:02:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bc683614-47ce-4f3c-a633-7186315e82b6 tempest-ServersNegativeTestJSON-269375622 None] Created volume successfully. Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Flow 'volume_create_manager' (55686d0d-6d5e-4d97-9ae7-19de438faa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b55564-b324-4116-9837-e18d87aa5a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b55564-b324-4116-9837-e18d87aa5a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1667158081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3dc1d2-0312-4359-a31c-2e0ca9a52a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e94645fe4441beba503fa5e6062027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:02:15Z,use_quota=True,user_id='c94d898763b9455ab4082e63d6f3d7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d05847-a25e-4031-9314-e6b3b609102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d05847-a25e-4031-9314-e6b3b609102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209ced71-5d0d-4065-9f4e-dcb1d3516f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209ced71-5d0d-4065-9f4e-dcb1d3516f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3dc1d2-0312-4359-a31c-2e0ca9a52a51', 'volume_name': 'volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64ba65b-2cea-4bfd-b1bb-abb89e1b4eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64ba65b-2cea-4bfd-b1bb-abb89e1b4eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02029dc-ddd1-48a4-b62c-e22cfd97e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Volume 3a3dc1d2-0312-4359-a31c-2e0ca9a52a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51', 'volume_size': 1} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1667158081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3dc1d2-0312-4359-a31c-2e0ca9a52a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e94645fe4441beba503fa5e6062027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:02:15Z,use_quota=True,user_id='c94d898763b9455ab4082e63d6f3d7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Creating volume 3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:02:15 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:15 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 1073741824 Jul 17 07:02:15 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:15 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 1073741824" returned: 0 in 0.529s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:15 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 Jul 17 07:02:15 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:16 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51" returned: 0 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02029dc-ddd1-48a4-b62c-e22cfd97e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09241294-6a47-4643-a564-01536df78f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Volume volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 (3a3dc1d2-0312-4359-a31c-2e0ca9a52a51): created successfully Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09241294-6a47-4643-a564-01536df78f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Flow 'volume_create_manager' (55686d0d-6d5e-4d97-9ae7-19de438faa85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:02:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-30f92d79-277c-4f1a-9f95-9c27fc944993 tempest-ServersNegativeTestJSON-269375622 None] Created volume successfully. Jul 17 07:02:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "cinder-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:02:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:02:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "cinder-quobyte-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:02:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-quobyte-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:02:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff408e-11f5-4ee0-8574-25ac8fb2e9e0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:02:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:18 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 Jul 17 07:02:18 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:19 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51" returned: 0 in 0.633s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:19 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51 Jul 17 07:02:19 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:19 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-quobyte-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51" released by "delete_volume" :: held 1.153s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Created reservations ['2a3cfd37-7302-4c62-a497-ff3e159f7c51', 'f47c91e4-7799-4fae-b783-bbf925ea3aff', 'ee4106d9-baa0-4793-aebf-8f9db2e551b2', 'ab2031f1-a064-40d0-9bf4-45c3788df98c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:19 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:02:19 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:20 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.359s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:02:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Deleted volume successfully. Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5a057970-9276-4e87-90c2-fa593e2c52e0 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-3a3dc1d2-0312-4359-a31c-2e0ca9a52a51-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "cinder-d343f312-f37b-4cdb-9cdb-999f84eecf12-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-d343f312-f37b-4cdb-9cdb-999f84eecf12-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "cinder-quobyte-d343f312-f37b-4cdb-9cdb-999f84eecf12" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-quobyte-d343f312-f37b-4cdb-9cdb-999f84eecf12" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[013138d5-1374-48b4-bc61-0deb2baa8f18]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:02:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:21 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 Jul 17 07:02:21 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:21 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12" returned: 0 in 0.380s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:21 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12 Jul 17 07:02:21 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:21 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d343f312-f37b-4cdb-9cdb-999f84eecf12" returned: 0 in 0.288s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-quobyte-d343f312-f37b-4cdb-9cdb-999f84eecf12" released by "delete_volume" :: held 0.724s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Created reservations ['eef9834b-a504-473d-8494-2171256f013e', 'e91c355e-d3cb-451a-96d5-9ce1274a900a', 'd5b4b8e6-a90d-4788-9fa5-493509a4022e', '6eeccaac-7846-4bbd-8a63-922d335fd284'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:21 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:02:21 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:22 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.343s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:22 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:02:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Deleted volume successfully. Jul 17 07:02:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9edfe4c2-e5b4-4d40-810f-8347526b1856 tempest-ServersNegativeTestJSON-269375622 None] Lock "cinder-d343f312-f37b-4cdb-9cdb-999f84eecf12-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:29 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:02:29 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:30 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.363s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 8 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Flow 'volume_create_manager' (192ea432-3054-492f-8f97-7c5b2751f719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a8c415-cd01-453d-ad8e-d622ea51440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a8c415-cd01-453d-ad8e-d622ea51440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-336640295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afef79f-71ed-4170-acfb-a3ed2a2efb63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11471c127945d7abd6441aeaff9a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:02:31Z,use_quota=True,user_id='b9ae484239254fe488429569bc4e29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7172251-d7e7-4e8d-9179-417be5065cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7172251-d7e7-4e8d-9179-417be5065cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6509e6-85c1-41bc-be86-30c7be5575de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6509e6-85c1-41bc-be86-30c7be5575de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3afef79f-71ed-4170-acfb-a3ed2a2efb63', 'volume_name': 'volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4327bfe7-ae0b-4887-8c03-4ae90d4b82a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4327bfe7-ae0b-4887-8c03-4ae90d4b82a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4b2ba5-9ade-4e9b-87a0-1be3556f9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:30 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Volume 3afef79f-71ed-4170-acfb-a3ed2a2efb63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63', 'volume_size': 1} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-336640295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afef79f-71ed-4170-acfb-a3ed2a2efb63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11471c127945d7abd6441aeaff9a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:02:31Z,use_quota=True,user_id='b9ae484239254fe488429569bc4e29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Creating volume 3afef79f-71ed-4170-acfb-a3ed2a2efb63 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:02:30 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:02:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:30 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 1073741824 Jul 17 07:02:30 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:31 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 1073741824" returned: 0 in 0.594s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:02:31 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 Jul 17 07:02:31 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:02:31 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63" returned: 0 in 0.297s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4b2ba5-9ade-4e9b-87a0-1be3556f9f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c57742-0f03-4dea-a932-965582665158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:02:31 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Volume volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 (3afef79f-71ed-4170-acfb-a3ed2a2efb63): created successfully Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c57742-0f03-4dea-a932-965582665158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:02:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Flow 'volume_create_manager' (192ea432-3054-492f-8f97-7c5b2751f719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:02:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-50776bbc-c408-48d9-ac13-6bd98f9cc943 tempest-ServerActionsTestOtherA-90293616 None] Created volume successfully. Jul 17 07:02:41 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=22,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:02:44 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=5 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Flow 'volume_create_manager' (eb6ff46b-c471-453a-ab0b-362255343b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7045e57-eea5-493d-ab1e-b1de2e62c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7045e57-eea5-493d-ab1e-b1de2e62c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-249612581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d2bed8-0604-4e02-a5bc-d90b1b305446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9062ce3a25646a6b0afed5429043c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:03:05Z,use_quota=True,user_id='576db6afb49e4dcf9d151a6204cd4f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60deb5dc-aa37-4257-9f95-0dd30c55ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60deb5dc-aa37-4257-9f95-0dd30c55ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fa8370-f47f-45bf-afb4-ee3b4afe1255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fa8370-f47f-45bf-afb4-ee3b4afe1255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d2bed8-0604-4e02-a5bc-d90b1b305446', 'volume_name': 'volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661efe91-d1b0-42c4-903f-ded00b99c0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661efe91-d1b0-42c4-903f-ded00b99c0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cb1b26-d3c2-4ea0-b402-da173d9cf0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Volume b8d2bed8-0604-4e02-a5bc-d90b1b305446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446', 'volume_size': 1} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-249612581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d2bed8-0604-4e02-a5bc-d90b1b305446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9062ce3a25646a6b0afed5429043c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:03:05Z,use_quota=True,user_id='576db6afb49e4dcf9d151a6204cd4f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Creating volume b8d2bed8-0604-4e02-a5bc-d90b1b305446 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:03:05 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:03:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:05 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 1073741824 Jul 17 07:03:05 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:06 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 1073741824" returned: 0 in 1.097s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:06 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 Jul 17 07:03:06 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:07 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446" returned: 0 in 0.851s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cb1b26-d3c2-4ea0-b402-da173d9cf0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4024011-c762-4a1c-a207-80a6a9f96f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Volume volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 (b8d2bed8-0604-4e02-a5bc-d90b1b305446): created successfully Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4024011-c762-4a1c-a207-80a6a9f96f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Flow 'volume_create_manager' (eb6ff46b-c471-453a-ab0b-362255343b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:03:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ca0c841d-cf68-41e9-a8a2-789712c09152 tempest-ServerRescueNegativeTestJSON-2089285523 None] Created volume successfully. Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Flow 'volume_create_manager' (28536d0d-3e72-4a60-9f0e-32abfdfd22e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a383778b-746d-4ff0-af6b-520cd7beff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a383778b-746d-4ff0-af6b-520cd7beff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-757674166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69dab0f-1eb4-46ed-934b-d7bab0e16497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7fe0d1156a4c958033d40e86f8cab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:03:13Z,use_quota=True,user_id='8039574ac50648d9878ad767acb237aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0afb75-a4f2-4f14-9cda-7bc0bac7abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0afb75-a4f2-4f14-9cda-7bc0bac7abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7a30a3-1a19-45f9-8f47-b517f6de74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7a30a3-1a19-45f9-8f47-b517f6de74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69dab0f-1eb4-46ed-934b-d7bab0e16497', 'volume_name': 'volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97d186f-afeb-405f-88bf-e08a8783e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97d186f-afeb-405f-88bf-e08a8783e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521aa3ab-7aee-44d2-afd5-e89627ad7703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:13 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Volume d69dab0f-1eb4-46ed-934b-d7bab0e16497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497', 'volume_size': 1} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-757674166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69dab0f-1eb4-46ed-934b-d7bab0e16497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7fe0d1156a4c958033d40e86f8cab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:03:13Z,use_quota=True,user_id='8039574ac50648d9878ad767acb237aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Creating volume d69dab0f-1eb4-46ed-934b-d7bab0e16497 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:03:13 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:03:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:13 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 1073741824 Jul 17 07:03:13 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:14 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 1073741824" returned: 0 in 0.915s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:14 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 Jul 17 07:03:14 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:14 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497" returned: 0 in 0.464s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:03:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521aa3ab-7aee-44d2-afd5-e89627ad7703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0fd346-3fc8-4c29-a65b-251346c2978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Volume volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 (d69dab0f-1eb4-46ed-934b-d7bab0e16497): created successfully Jul 17 07:03:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0fd346-3fc8-4c29-a65b-251346c2978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Flow 'volume_create_manager' (28536d0d-3e72-4a60-9f0e-32abfdfd22e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:03:15 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0d4c2ce4-24e2-49c1-b8bd-500472f080c9 tempest-DeleteServersTestJSON-1793672978 None] Created volume successfully. Jul 17 07:03:21 devstack cinder-volume[87331]: WARNING py.warnings [req-c7ac6dbe-ac32-43ea-81f5-3b03cffc5d50 req-ac9a6259-de4f-493e-b2cc-237b83e0cb08 tempest-DeleteServersTestJSON-1793672978 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 17 07:03:21 devstack cinder-volume[87331]: .first() Jul 17 07:03:21 devstack cinder-volume[87331]: Jul 17 07:03:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c7ac6dbe-ac32-43ea-81f5-3b03cffc5d50 req-ac9a6259-de4f-493e-b2cc-237b83e0cb08 tempest-DeleteServersTestJSON-1793672978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c7ac6dbe-ac32-43ea-81f5-3b03cffc5d50 req-ac9a6259-de4f-493e-b2cc-237b83e0cb08 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c7ac6dbe-ac32-43ea-81f5-3b03cffc5d50 req-ac9a6259-de4f-493e-b2cc-237b83e0cb08 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-c7ac6dbe-ac32-43ea-81f5-3b03cffc5d50 req-ac9a6259-de4f-493e-b2cc-237b83e0cb08 tempest-DeleteServersTestJSON-1793672978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1559ee4e-e5eb-49ee-9870-1158c1c082a4', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:03:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-c7ac6dbe-ac32-43ea-81f5-3b03cffc5d50 req-ac9a6259-de4f-493e-b2cc-237b83e0cb08 tempest-DeleteServersTestJSON-1793672978 None] attachment_update completed successfully. Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Acquiring lock "cinder-b8d2bed8-0604-4e02-a5bc-d90b1b305446-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "cinder-b8d2bed8-0604-4e02-a5bc-d90b1b305446-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Acquiring lock "cinder-quobyte-b8d2bed8-0604-4e02-a5bc-d90b1b305446" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "cinder-quobyte-b8d2bed8-0604-4e02-a5bc-d90b1b305446" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e905584-1b4e-41ce-a9a1-c96d835a7dc9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:24 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 Jul 17 07:03:24 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:24 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446" returned: 0 in 0.477s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:25 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446 Jul 17 07:03:25 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:25 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8d2bed8-0604-4e02-a5bc-d90b1b305446" returned: 0 in 0.711s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "cinder-quobyte-b8d2bed8-0604-4e02-a5bc-d90b1b305446" released by "delete_volume" :: held 1.270s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:03:25 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Created reservations ['d8e02897-1f86-4c87-abff-2691da90c9f8', '5931c429-0c41-4526-9b8f-731001d3bda6', '0a50d5a5-7b17-4f1e-959a-acebc20b7db2', 'adbf9163-e55b-48dd-8805-428a060c85d7'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:26 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:03:26 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:26 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.808s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:26 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:03:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Deleted volume successfully. Jul 17 07:03:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-88b21d72-f9fb-4952-9e23-117d2da36e81 tempest-ServerRescueNegativeTestJSON-2089285523 None] Lock "cinder-b8d2bed8-0604-4e02-a5bc-d90b1b305446-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:03:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-3baceaf3-adad-49b9-848c-defe403faa27 req-4c937101-0c29-4dec-b585-4adfce981ecb tempest-DeleteServersTestJSON-1793672978 None] Terminate volume connection completed successfully. Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-3baceaf3-adad-49b9-848c-defe403faa27 req-4c937101-0c29-4dec-b585-4adfce981ecb tempest-DeleteServersTestJSON-1793672978 None] Deleting attachment 1559ee4e-e5eb-49ee-9870-1158c1c082a4. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:29 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:03:29 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:30 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.595s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:03:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Acquiring lock "cinder-d69dab0f-1eb4-46ed-934b-d7bab0e16497-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:03:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Lock "cinder-d69dab0f-1eb4-46ed-934b-d7bab0e16497-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:03:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Acquiring lock "cinder-quobyte-d69dab0f-1eb4-46ed-934b-d7bab0e16497" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:03:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Lock "cinder-quobyte-d69dab0f-1eb4-46ed-934b-d7bab0e16497" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:03:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cd76b2-6dd4-477b-9ffc-2436f4cca6a9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:03:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:32 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 Jul 17 07:03:32 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:33 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497" returned: 0 in 0.714s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:33 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497 Jul 17 07:03:33 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:33 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d69dab0f-1eb4-46ed-934b-d7bab0e16497" returned: 0 in 0.801s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Lock "cinder-quobyte-d69dab0f-1eb4-46ed-934b-d7bab0e16497" released by "delete_volume" :: held 1.647s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Created reservations ['ca666bc0-5e04-4a8e-b2da-ebd11690072c', '70f9af14-8e0e-4982-950e-9d2dd95f5730', '9d88d1e3-2e7d-45b6-aa31-47de31f00604', 'c5e6be51-19a5-49bd-ac4e-ab371d7fe102'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-860d02f7-131c-44f0-b4a4-413e6a2a0fd6 req-1e5d271f-e066-48e6-bbaf-67c25cc0f855 tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-860d02f7-131c-44f0-b4a4-413e6a2a0fd6 req-1e5d271f-e066-48e6-bbaf-67c25cc0f855 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-860d02f7-131c-44f0-b4a4-413e6a2a0fd6 req-1e5d271f-e066-48e6-bbaf-67c25cc0f855 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-860d02f7-131c-44f0-b4a4-413e6a2a0fd6 req-1e5d271f-e066-48e6-bbaf-67c25cc0f855 tempest-ServerActionsTestOtherA-90293616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fa55692-c32c-4aa9-90b4-fda32471553e', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:34 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:03:34 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-860d02f7-131c-44f0-b4a4-413e6a2a0fd6 req-1e5d271f-e066-48e6-bbaf-67c25cc0f855 tempest-ServerActionsTestOtherA-90293616 None] attachment_update completed successfully. Jul 17 07:03:34 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.559s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:03:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Deleted volume successfully. Jul 17 07:03:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e7948a29-8ad1-4575-8fa8-a8dc99965c70 tempest-DeleteServersTestJSON-1793672978 None] Lock "cinder-d69dab0f-1eb4-46ed-934b-d7bab0e16497-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:03:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0819a943-acec-44cf-ace6-88b740d43933 tempest-ServerActionsTestOtherA-90293616 None] Terminate volume connection completed successfully. Jul 17 07:03:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0819a943-acec-44cf-ace6-88b740d43933 tempest-ServerActionsTestOtherA-90293616 None] Deleting attachment 9fa55692-c32c-4aa9-90b4-fda32471553e. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:03:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0cfa7c7f-dd8c-4e07-9f7e-d631086675fb tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0cfa7c7f-dd8c-4e07-9f7e-d631086675fb tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0cfa7c7f-dd8c-4e07-9f7e-d631086675fb tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0cfa7c7f-dd8c-4e07-9f7e-d631086675fb tempest-ServerActionsTestOtherA-90293616 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11401aa1-1742-4364-9d8a-5aa596602da7', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:03:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-de71b9d9-7893-40c1-b71e-ead4da9a7436 req-0cfa7c7f-dd8c-4e07-9f7e-d631086675fb tempest-ServerActionsTestOtherA-90293616 None] attachment_update completed successfully. Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Flow 'volume_create_manager' (66373f12-5cd4-4cd5-be92-2765c11efcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff0f051-0a7f-482d-a7fb-490e0d1e716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff0f051-0a7f-482d-a7fb-490e0d1e716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-582760667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58025110-830d-4326-9c5c-061aff1685fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a53d52af21446e9b74983d655d20f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:03:48Z,use_quota=True,user_id='4e6a0f07f3ef439fa18dff02b5bb2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc1f982-58d3-4214-bf8c-f5d44cd7a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc1f982-58d3-4214-bf8c-f5d44cd7a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70441c5-49f8-4aa1-bdb0-11515bfc95f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70441c5-49f8-4aa1-bdb0-11515bfc95f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58025110-830d-4326-9c5c-061aff1685fb', 'volume_name': 'volume-58025110-830d-4326-9c5c-061aff1685fb', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd9ac85-93a1-4942-a948-ea3126f0db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd9ac85-93a1-4942-a948-ea3126f0db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fed26c5-3ae9-4ffb-a4ce-79ed2ef18e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:48 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Volume 58025110-830d-4326-9c5c-061aff1685fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58025110-830d-4326-9c5c-061aff1685fb', 'volume_size': 1} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-582760667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58025110-830d-4326-9c5c-061aff1685fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a53d52af21446e9b74983d655d20f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:03:48Z,use_quota=True,user_id='4e6a0f07f3ef439fa18dff02b5bb2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Creating volume 58025110-830d-4326-9c5c-061aff1685fb {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:03:48 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:48 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb 1073741824 Jul 17 07:03:48 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:48 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb 1073741824" returned: 0 in 0.609s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:03:48 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb Jul 17 07:03:48 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:03:49 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fed26c5-3ae9-4ffb-a4ce-79ed2ef18e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58025110-830d-4326-9c5c-061aff1685fb', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e16c933-50a9-4aa2-b155-06b6668745f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:03:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Volume volume-58025110-830d-4326-9c5c-061aff1685fb (58025110-830d-4326-9c5c-061aff1685fb): created successfully Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e16c933-50a9-4aa2-b155-06b6668745f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:03:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Flow 'volume_create_manager' (66373f12-5cd4-4cd5-be92-2765c11efcec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:03:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-94b7563c-16a5-4e69-8b85-c6e00d81727a tempest-AttachVolumeNegativeTest-1246012281 None] Created volume successfully. Jul 17 07:03:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-501fb592-0c1f-4805-b486-f9395998709c req-714d019c-16e7-401e-b845-cc8b19666fbf tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:03:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-501fb592-0c1f-4805-b486-f9395998709c req-714d019c-16e7-401e-b845-cc8b19666fbf tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:03:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-501fb592-0c1f-4805-b486-f9395998709c req-714d019c-16e7-401e-b845-cc8b19666fbf tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:03:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-501fb592-0c1f-4805-b486-f9395998709c req-714d019c-16e7-401e-b845-cc8b19666fbf tempest-AttachVolumeNegativeTest-1246012281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-58025110-830d-4326-9c5c-061aff1685fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '629dad6d-384e-4e91-beed-48c621e81205', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:03:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-501fb592-0c1f-4805-b486-f9395998709c req-714d019c-16e7-401e-b845-cc8b19666fbf tempest-AttachVolumeNegativeTest-1246012281 None] attachment_update completed successfully. Jul 17 07:04:01 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=50,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:04:01 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:04:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-f6e30d19-46fc-4c24-989b-a8b6a1009d54 req-8ab3c329-ed89-4dfd-bff0-c8328daf37a4 tempest-ServerActionsTestOtherA-90293616 None] Terminate volume connection completed successfully. Jul 17 07:04:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-f6e30d19-46fc-4c24-989b-a8b6a1009d54 req-8ab3c329-ed89-4dfd-bff0-c8328daf37a4 tempest-ServerActionsTestOtherA-90293616 None] Deleting attachment 11401aa1-1742-4364-9d8a-5aa596602da7. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:04:24 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:04:24 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:04:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "cinder-3afef79f-71ed-4170-acfb-a3ed2a2efb63-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Lock "cinder-3afef79f-71ed-4170-acfb-a3ed2a2efb63-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "cinder-quobyte-3afef79f-71ed-4170-acfb-a3ed2a2efb63" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Lock "cinder-quobyte-3afef79f-71ed-4170-acfb-a3ed2a2efb63" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d526628-e945-4c3b-96f2-cfec188f294a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:04:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:26 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 Jul 17 07:04:26 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:27 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:27 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63 Jul 17 07:04:27 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:27 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3afef79f-71ed-4170-acfb-a3ed2a2efb63" returned: 0 in 0.272s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Lock "cinder-quobyte-3afef79f-71ed-4170-acfb-a3ed2a2efb63" released by "delete_volume" :: held 0.767s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Created reservations ['90c9a1ec-83b4-412f-bb29-f68238ebbf8d', 'd6bd18f7-5890-4ac0-971e-e9d0cf4b70d9', '3758e64a-3518-4c8e-81b7-e25a4ce75130', '15659d57-9fc2-4ef4-9dd1-29e850e7a3b2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:27 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:04:27 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:27 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:04:27 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Deleted volume successfully. Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a02caf92-1fd5-4940-bf13-c1b3d09aa952 tempest-ServerActionsTestOtherA-90293616 None] Lock "cinder-3afef79f-71ed-4170-acfb-a3ed2a2efb63-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Flow 'volume_create_manager' (911a6358-9c34-44ed-b333-cfa1bc3dae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a30636-c403-4eb2-9d42-ab0e199eac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a30636-c403-4eb2-9d42-ab0e199eac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1078597549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afffb600-70a9-47f2-aafa-24ecba29885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054ec68d9e4f4b328da1f3326f1bd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:28Z,use_quota=True,user_id='9a9bc059d07d4fd69a6ff25d4888230f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3260ba3d-08d5-45ab-ad62-05804ee05dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3260ba3d-08d5-45ab-ad62-05804ee05dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea2d141-8119-4233-bf26-9738056421c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea2d141-8119-4233-bf26-9738056421c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afffb600-70a9-47f2-aafa-24ecba29885e', 'volume_name': 'volume-afffb600-70a9-47f2-aafa-24ecba29885e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae134de4-70fc-4020-94f8-8f3e4abbc9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae134de4-70fc-4020-94f8-8f3e4abbc9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a2cbfb-839f-49ec-bd66-d8561be6ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:27 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Volume afffb600-70a9-47f2-aafa-24ecba29885e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afffb600-70a9-47f2-aafa-24ecba29885e', 'volume_size': 1} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1078597549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afffb600-70a9-47f2-aafa-24ecba29885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054ec68d9e4f4b328da1f3326f1bd709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:28Z,use_quota=True,user_id='9a9bc059d07d4fd69a6ff25d4888230f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Creating volume afffb600-70a9-47f2-aafa-24ecba29885e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:04:27 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:04:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:27 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e 1073741824 Jul 17 07:04:27 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:28 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e 1073741824" returned: 0 in 0.569s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:28 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e Jul 17 07:04:28 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:28 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a2cbfb-839f-49ec-bd66-d8561be6ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afffb600-70a9-47f2-aafa-24ecba29885e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186b990e-2f7c-418f-9704-5c1be91ed702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Volume volume-afffb600-70a9-47f2-aafa-24ecba29885e (afffb600-70a9-47f2-aafa-24ecba29885e): created successfully Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186b990e-2f7c-418f-9704-5c1be91ed702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Flow 'volume_create_manager' (911a6358-9c34-44ed-b333-cfa1bc3dae43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4185363a-30e1-425d-a22a-a8badda35f52 tempest-TaggedAttachmentsTest-280738593 None] Created volume successfully. Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:29 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:04:29 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:30 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.298s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:04:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:04:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 8 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:04:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:04:38 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:04:40 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:04:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Flow 'volume_create_manager' (3164c326-f368-4911-aacc-b9817468c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883aa589-15cc-4680-8b64-87015ef4ae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883aa589-15cc-4680-8b64-87015ef4ae04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1736528639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69d19e-8011-4016-b7a3-7299d5dd300e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799ec0313a14882a448b36c88c73301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:41Z,use_quota=True,user_id='9473c096ea36474c806dfaafb486ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24bbf9a-e85d-4709-8f77-58219f5dc1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24bbf9a-e85d-4709-8f77-58219f5dc1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f30337-9375-4ac5-a816-f2eee478b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f30337-9375-4ac5-a816-f2eee478b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf69d19e-8011-4016-b7a3-7299d5dd300e', 'volume_name': 'volume-bf69d19e-8011-4016-b7a3-7299d5dd300e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9b869d-03ce-4ca1-aedf-d0e7ad1523e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9b869d-03ce-4ca1-aedf-d0e7ad1523e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c991d5a-1f97-48e1-9eff-12f7e2327f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Volume bf69d19e-8011-4016-b7a3-7299d5dd300e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf69d19e-8011-4016-b7a3-7299d5dd300e', 'volume_size': 1} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1736528639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69d19e-8011-4016-b7a3-7299d5dd300e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799ec0313a14882a448b36c88c73301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:41Z,use_quota=True,user_id='9473c096ea36474c806dfaafb486ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Creating volume bf69d19e-8011-4016-b7a3-7299d5dd300e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:04:41 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:41 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e 1073741824 Jul 17 07:04:41 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:41 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e 1073741824" returned: 0 in 0.757s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:41 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e Jul 17 07:04:41 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Flow 'volume_create_manager' (cfd44569-763b-487e-b408-e3720c63c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eec0ebb-5fcc-4cfc-abaa-ba19b3992d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eec0ebb-5fcc-4cfc-abaa-ba19b3992d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1643280077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af222a22-3b8f-4a60-a64d-17e2ccd5a186,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98111819cad642e2a33c01a50b417386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:42Z,use_quota=True,user_id='561af66d9ca5466aae746a5aa51998bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba18128-5aad-4290-a7ab-ea9d1d5efcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:42 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba18128-5aad-4290-a7ab-ea9d1d5efcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50b2016-12e6-4af1-b9fe-ff019c003e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50b2016-12e6-4af1-b9fe-ff019c003e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af222a22-3b8f-4a60-a64d-17e2ccd5a186', 'volume_name': 'volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b745438b-dbca-4956-b9ce-440cc801f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b745438b-dbca-4956-b9ce-440cc801f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fdfd3d-b5e0-4364-9971-387dc119b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Volume af222a22-3b8f-4a60-a64d-17e2ccd5a186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186', 'volume_size': 1} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e" returned: 0 in 0.479s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1643280077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af222a22-3b8f-4a60-a64d-17e2ccd5a186,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98111819cad642e2a33c01a50b417386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:42Z,use_quota=True,user_id='561af66d9ca5466aae746a5aa51998bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Creating volume af222a22-3b8f-4a60-a64d-17e2ccd5a186 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:04:42 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c991d5a-1f97-48e1-9eff-12f7e2327f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf69d19e-8011-4016-b7a3-7299d5dd300e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:42 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 1073741824 Jul 17 07:04:42 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439e8dbb-5d95-4a8d-b1fe-e1507afb9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Volume volume-bf69d19e-8011-4016-b7a3-7299d5dd300e (bf69d19e-8011-4016-b7a3-7299d5dd300e): created successfully Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439e8dbb-5d95-4a8d-b1fe-e1507afb9234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Flow 'volume_create_manager' (3164c326-f368-4911-aacc-b9817468c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1afccf20-c482-4051-9cb1-22861c5369f9 tempest-AttachVolumeTestJSON-501762225 None] Created volume successfully. Jul 17 07:04:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-7b24e087-d919-4e14-ad1e-d515f2b8652f req-6153d2ae-cfd2-48ac-85e6-e72a60a17c9f tempest-AttachVolumeNegativeTest-1246012281 None] Terminate volume connection completed successfully. Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-7b24e087-d919-4e14-ad1e-d515f2b8652f req-6153d2ae-cfd2-48ac-85e6-e72a60a17c9f tempest-AttachVolumeNegativeTest-1246012281 None] Deleting attachment 629dad6d-384e-4e91-beed-48c621e81205. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:04:42 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 1073741824" returned: 0 in 0.534s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:43 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 Jul 17 07:04:43 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:43 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fdfd3d-b5e0-4364-9971-387dc119b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5660ab0e-11a4-44d1-9f85-c82e22eae99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Volume volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 (af222a22-3b8f-4a60-a64d-17e2ccd5a186): created successfully Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5660ab0e-11a4-44d1-9f85-c82e22eae99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Flow 'volume_create_manager' (cfd44569-763b-487e-b408-e3720c63c01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a15c31cf-aaf1-4199-889d-69e6836b760d tempest-VolumesTestJSON-716245860 None] Created volume successfully. Jul 17 07:04:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-cced0ee6-f91d-4c72-847e-5ef2488ec83c req-61cdf41c-e502-4042-807a-05a2fe5f8ad6 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-cced0ee6-f91d-4c72-847e-5ef2488ec83c req-61cdf41c-e502-4042-807a-05a2fe5f8ad6 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-cced0ee6-f91d-4c72-847e-5ef2488ec83c req-61cdf41c-e502-4042-807a-05a2fe5f8ad6 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.119s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-cced0ee6-f91d-4c72-847e-5ef2488ec83c req-61cdf41c-e502-4042-807a-05a2fe5f8ad6 tempest-AttachVolumeTestJSON-501762225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-bf69d19e-8011-4016-b7a3-7299d5dd300e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a52b019c-a5d2-4558-9bc5-c84d522ceab0', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:04:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-cced0ee6-f91d-4c72-847e-5ef2488ec83c req-61cdf41c-e502-4042-807a-05a2fe5f8ad6 tempest-AttachVolumeTestJSON-501762225 None] attachment_update completed successfully. Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Flow 'volume_create_manager' (b67084ce-15c4-47ab-b22a-b9eaac09b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918afb3e-be81-40c9-a925-686303abe7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918afb3e-be81-40c9-a925-686303abe7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2072983462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a89d17-a9e2-4f4f-8644-d4e590bda2ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98111819cad642e2a33c01a50b417386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:45Z,use_quota=True,user_id='561af66d9ca5466aae746a5aa51998bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add1b8c6-7ea5-4a73-a124-5ac3eb810a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add1b8c6-7ea5-4a73-a124-5ac3eb810a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f7afb8-f333-4f34-b317-70b1a100bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f7afb8-f333-4f34-b317-70b1a100bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a89d17-a9e2-4f4f-8644-d4e590bda2ff', 'volume_name': 'volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79ef9b8-7d16-485d-b4b8-f23382c1c509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79ef9b8-7d16-485d-b4b8-f23382c1c509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388a183-bf0f-4a5a-a8b5-a0f15b7d226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Volume 00a89d17-a9e2-4f4f-8644-d4e590bda2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff', 'volume_size': 1} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2072983462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a89d17-a9e2-4f4f-8644-d4e590bda2ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98111819cad642e2a33c01a50b417386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:45Z,use_quota=True,user_id='561af66d9ca5466aae746a5aa51998bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Creating volume 00a89d17-a9e2-4f4f-8644-d4e590bda2ff {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:04:45 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:04:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:45 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff 1073741824 Jul 17 07:04:45 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:46 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff 1073741824" returned: 0 in 1.089s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:46 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff Jul 17 07:04:46 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:47 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388a183-bf0f-4a5a-a8b5-a0f15b7d226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fad840-2caf-456f-b49c-0ce8c37a6944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:47 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Volume volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff (00a89d17-a9e2-4f4f-8644-d4e590bda2ff): created successfully Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fad840-2caf-456f-b49c-0ce8c37a6944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Flow 'volume_create_manager' (b67084ce-15c4-47ab-b22a-b9eaac09b233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-94cd70c8-fedb-47f4-922a-da91774acb55 tempest-VolumesTestJSON-716245860 None] Created volume successfully. Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Flow 'volume_create_manager' (0f3a352a-e8f5-44e4-8395-722f86b177d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac101eb-3106-469f-83ea-022f7679343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac101eb-3106-469f-83ea-022f7679343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239578672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9987de5c-3d05-485d-af09-5a5802e10bb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98111819cad642e2a33c01a50b417386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:48Z,use_quota=True,user_id='561af66d9ca5466aae746a5aa51998bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0f1e9b-a963-403a-8647-9654dfa45ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0f1e9b-a963-403a-8647-9654dfa45ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa9d15b-9369-4ca4-ac9e-4f4896e405de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa9d15b-9369-4ca4-ac9e-4f4896e405de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9987de5c-3d05-485d-af09-5a5802e10bb1', 'volume_name': 'volume-9987de5c-3d05-485d-af09-5a5802e10bb1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66888350-5b72-4e31-b487-97f5be0145f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66888350-5b72-4e31-b487-97f5be0145f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257e5994-6981-486e-8eea-1bb402df816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:48 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Volume 9987de5c-3d05-485d-af09-5a5802e10bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9987de5c-3d05-485d-af09-5a5802e10bb1', 'volume_size': 1} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239578672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9987de5c-3d05-485d-af09-5a5802e10bb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98111819cad642e2a33c01a50b417386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:04:48Z,use_quota=True,user_id='561af66d9ca5466aae746a5aa51998bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Creating volume 9987de5c-3d05-485d-af09-5a5802e10bb1 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:04:48 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:04:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:48 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 1073741824 Jul 17 07:04:48 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:49 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 1073741824" returned: 0 in 0.626s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:49 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 Jul 17 07:04:49 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:49 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1" returned: 0 in 0.437s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257e5994-6981-486e-8eea-1bb402df816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9987de5c-3d05-485d-af09-5a5802e10bb1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3335570c-864e-461c-b2c7-951d17650845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:04:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Volume volume-9987de5c-3d05-485d-af09-5a5802e10bb1 (9987de5c-3d05-485d-af09-5a5802e10bb1): created successfully Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3335570c-864e-461c-b2c7-951d17650845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:04:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Flow 'volume_create_manager' (0f3a352a-e8f5-44e4-8395-722f86b177d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:04:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4301bcfe-9a32-4f10-97e2-391f1175d498 tempest-VolumesTestJSON-716245860 None] Created volume successfully. Jul 17 07:04:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Acquiring lock "cinder-9987de5c-3d05-485d-af09-5a5802e10bb1-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Lock "cinder-9987de5c-3d05-485d-af09-5a5802e10bb1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Acquiring lock "cinder-quobyte-9987de5c-3d05-485d-af09-5a5802e10bb1" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Lock "cinder-quobyte-9987de5c-3d05-485d-af09-5a5802e10bb1" acquired by "delete_volume" :: waited 0.037s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8921d-d672-4a3f-81e4-4ecc1276abab]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:04:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:53 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 Jul 17 07:04:53 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:53 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1" returned: 0 in 0.737s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:53 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1 Jul 17 07:04:53 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:53 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9987de5c-3d05-485d-af09-5a5802e10bb1" returned: 0 in 0.360s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Lock "cinder-quobyte-9987de5c-3d05-485d-af09-5a5802e10bb1" released by "delete_volume" :: held 1.166s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Created reservations ['666e3dac-baea-480d-9c42-9e69e4ac9791', 'b83949bb-6a23-4c54-ad93-6d84100943d8', '05ee4fa3-efaa-4910-a1f9-c9a5c03407a7', 'd9f45a4c-6203-414a-89b5-82221c015388'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:54 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:04:54 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:54 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.475s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:04:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Deleted volume successfully. Jul 17 07:04:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f5a2b35c-8db6-4c8c-aec2-3d498326db1d tempest-VolumesTestJSON-716245860 None] Lock "cinder-9987de5c-3d05-485d-af09-5a5802e10bb1-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Acquiring lock "cinder-00a89d17-a9e2-4f4f-8644-d4e590bda2ff-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Lock "cinder-00a89d17-a9e2-4f4f-8644-d4e590bda2ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Acquiring lock "cinder-quobyte-00a89d17-a9e2-4f4f-8644-d4e590bda2ff" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Lock "cinder-quobyte-00a89d17-a9e2-4f4f-8644-d4e590bda2ff" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e5176-e615-41a6-972f-d87e18ad22f9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:55 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff Jul 17 07:04:55 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:55 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff" returned: 0 in 0.453s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:55 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff Jul 17 07:04:55 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:56 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00a89d17-a9e2-4f4f-8644-d4e590bda2ff" returned: 0 in 0.513s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Lock "cinder-quobyte-00a89d17-a9e2-4f4f-8644-d4e590bda2ff" released by "delete_volume" :: held 1.053s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Created reservations ['47edc51c-fe9d-49a5-910e-136072dab88e', 'e4a74740-63ee-47d5-9027-3c71f49214d9', '2a8545e2-b4fc-466b-b2dd-404c495a60b8', 'a386fd44-1709-41a7-8403-a6c6ac7c164f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:56 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:04:56 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:56 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.356s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:04:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Deleted volume successfully. Jul 17 07:04:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-563e028b-47dc-4fa4-8ee4-cc4a0ff11e42 tempest-VolumesTestJSON-716245860 None] Lock "cinder-00a89d17-a9e2-4f4f-8644-d4e590bda2ff-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Acquiring lock "cinder-af222a22-3b8f-4a60-a64d-17e2ccd5a186-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Lock "cinder-af222a22-3b8f-4a60-a64d-17e2ccd5a186-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Acquiring lock "cinder-quobyte-af222a22-3b8f-4a60-a64d-17e2ccd5a186" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:04:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Lock "cinder-quobyte-af222a22-3b8f-4a60-a64d-17e2ccd5a186" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:04:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1df832-f107-47a5-aa3f-21e111ed31de]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:04:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:57 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 Jul 17 07:04:57 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:58 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186" returned: 0 in 0.392s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:58 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186 Jul 17 07:04:58 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:58 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af222a22-3b8f-4a60-a64d-17e2ccd5a186" returned: 0 in 0.321s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Lock "cinder-quobyte-af222a22-3b8f-4a60-a64d-17e2ccd5a186" released by "delete_volume" :: held 0.783s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Created reservations ['23c2c320-6284-452c-b55f-26eb71b49676', 'adac8654-7bb6-4976-b2b9-05a7b8c77a1e', '24fb7940-69eb-48ff-bf53-318c204858e3', '879a96ff-d8c0-4be7-bc46-bb5a76829f13'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:04:58 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:04:58 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:04:58 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.298s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:04:58 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Deleted volume successfully. Jul 17 07:04:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b8ee1c5-cd03-4795-831e-b6cbc2a8733c tempest-VolumesTestJSON-716245860 None] Lock "cinder-af222a22-3b8f-4a60-a64d-17e2ccd5a186-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:05:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-336ee6f7-f07c-4c8b-9065-8ad13439d685 tempest-BackendsCapabilitiesAdminTestsJSON-1841396139 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87331) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 07:05:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03263eea-8418-4162-9d2c-6fd4da33cd55 tempest-BackendsCapabilitiesAdminTestsJSON-1841396139 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87331) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 07:05:08 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=32,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:05:08 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=36,cinder:INSERT=13,cinder:UPDATE=51,cinder:DELETE=3 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:05:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b220dfe5-e284-490e-88ae-ca9fb365ad9a tempest-GroupsTest-1096244990 None] Group tempest-Group1-1353355313: creating Jul 17 07:05:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b220dfe5-e284-490e-88ae-ca9fb365ad9a tempest-GroupsTest-1096244990 None] Group tempest-Group1-1353355313: created successfully Jul 17 07:05:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b220dfe5-e284-490e-88ae-ca9fb365ad9a tempest-GroupsTest-1096244990 None] Create group completed successfully. Jul 17 07:05:12 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-02fa9d3a-3742-4949-950d-f669b8e69139 tempest-GroupsTest-1096244990 None] Group tempest-Group2-711808399: creating Jul 17 07:05:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-02fa9d3a-3742-4949-950d-f669b8e69139 tempest-GroupsTest-1096244990 None] Group tempest-Group2-711808399: created successfully Jul 17 07:05:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-02fa9d3a-3742-4949-950d-f669b8e69139 tempest-GroupsTest-1096244990 None] Create group completed successfully. Jul 17 07:05:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c690cd39-65ce-4b20-900d-5e465100c6f3 req-4c107263-e328-47d0-bb1b-2ef5cba06741 tempest-TaggedAttachmentsTest-280738593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c690cd39-65ce-4b20-900d-5e465100c6f3 req-4c107263-e328-47d0-bb1b-2ef5cba06741 tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c690cd39-65ce-4b20-900d-5e465100c6f3 req-4c107263-e328-47d0-bb1b-2ef5cba06741 tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-c690cd39-65ce-4b20-900d-5e465100c6f3 req-4c107263-e328-47d0-bb1b-2ef5cba06741 tempest-TaggedAttachmentsTest-280738593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-afffb600-70a9-47f2-aafa-24ecba29885e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1eb3f50b-0cbc-41ef-aa50-0d78304a9636', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:05:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-c690cd39-65ce-4b20-900d-5e465100c6f3 req-4c107263-e328-47d0-bb1b-2ef5cba06741 tempest-TaggedAttachmentsTest-280738593 None] attachment_update completed successfully. Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Flow 'volume_create_manager' (784fcf9b-b625-4a14-8818-3ded5239cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5b2acf-ce63-4be2-9e92-bb5284db060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5b2acf-ce63-4be2-9e92-bb5284db060f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567897537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26b4afa3-94a9-4ad5-a079-07ffb1215f9f,host='devstack@QuobyteHD#QuobyteHD',id=b2cb46a9-9922-4d98-9695-8aa259e7bf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a19a53ddc444598e536b02ae680fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:15Z,use_quota=True,user_id='4478ed7f535f467db971c38954638926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe33459f-e83c-4bee-9caf-7c5de70c12cd),volume_type_id=fe33459f-e83c-4bee-9caf-7c5de70c12cd)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f693a4-05da-4e92-8b8b-9ec24fb42d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f693a4-05da-4e92-8b8b-9ec24fb42d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9aa5bf-1583-4118-8928-d4cca2c73512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9aa5bf-1583-4118-8928-d4cca2c73512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2cb46a9-9922-4d98-9695-8aa259e7bf2e', 'volume_name': 'volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f203fc86-40d3-4b8d-b3a7-46ff892236ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f203fc86-40d3-4b8d-b3a7-46ff892236ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc323304-d200-4974-9263-4937fc41e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Volume b2cb46a9-9922-4d98-9695-8aa259e7bf2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e', 'volume_size': 1} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=26b4afa3-94a9-4ad5-a079-07ffb1215f9f,created_at=2026-07-17T05:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567897537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26b4afa3-94a9-4ad5-a079-07ffb1215f9f,host='devstack@QuobyteHD#QuobyteHD',id=b2cb46a9-9922-4d98-9695-8aa259e7bf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a19a53ddc444598e536b02ae680fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:15Z,use_quota=True,user_id='4478ed7f535f467db971c38954638926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe33459f-e83c-4bee-9caf-7c5de70c12cd),volume_type_id=fe33459f-e83c-4bee-9caf-7c5de70c12cd)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Creating volume b2cb46a9-9922-4d98-9695-8aa259e7bf2e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:05:15 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:15 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e 1073741824 Jul 17 07:05:15 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:15 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e 1073741824" returned: 0 in 0.618s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:15 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e Jul 17 07:05:15 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-38dd7dc5-dd1a-4d1d-8aba-1724c0e07f49 req-e59b8f21-73c1-4c26-abce-e48cf0ecca5b tempest-TaggedAttachmentsTest-280738593 None] Terminate volume connection completed successfully. Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38dd7dc5-dd1a-4d1d-8aba-1724c0e07f49 req-e59b8f21-73c1-4c26-abce-e48cf0ecca5b tempest-TaggedAttachmentsTest-280738593 None] Deleting attachment 1eb3f50b-0cbc-41ef-aa50-0d78304a9636. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:05:16 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e" returned: 0 in 0.356s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc323304-d200-4974-9263-4937fc41e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b090f0-0915-44a3-95d5-591ec7b3381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Volume volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e (b2cb46a9-9922-4d98-9695-8aa259e7bf2e): created successfully Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b090f0-0915-44a3-95d5-591ec7b3381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Flow 'volume_create_manager' (784fcf9b-b625-4a14-8818-3ded5239cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bea529ff-5431-4792-93b2-b0210054bde3 tempest-GroupsTest-1096244990 None] Created volume successfully. Jul 17 07:05:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-a917454d-2e7b-4a99-a261-a51b54b51f72 req-3312481d-9e32-49e5-a8ea-2fafa76eebd4 tempest-AttachVolumeTestJSON-501762225 None] Terminate volume connection completed successfully. Jul 17 07:05:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-a917454d-2e7b-4a99-a261-a51b54b51f72 req-3312481d-9e32-49e5-a8ea-2fafa76eebd4 tempest-AttachVolumeTestJSON-501762225 None] Deleting attachment a52b019c-a5d2-4558-9bc5-c84d522ceab0. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Acquiring lock "cinder-quobyte-b2cb46a9-9922-4d98-9695-8aa259e7bf2e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Lock "cinder-quobyte-b2cb46a9-9922-4d98-9695-8aa259e7bf2e" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96db370-5781-4a68-9445-326d52838460]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:18 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e Jul 17 07:05:18 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:18 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e" returned: 0 in 0.414s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:18 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e Jul 17 07:05:18 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:18 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2cb46a9-9922-4d98-9695-8aa259e7bf2e" returned: 0 in 0.268s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Lock "cinder-quobyte-b2cb46a9-9922-4d98-9695-8aa259e7bf2e" released by "delete_volume" :: held 0.742s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Created reservations ['c6065bbc-7c19-4828-87b8-5f840f2e2b01'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:19 devstack cinder-volume[87331]: WARNING cinder.quota [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-908175848 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-908175848, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:05:19 devstack cinder-volume[87331]: WARNING cinder.quota [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-908175848 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-908175848, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Created reservations ['c861d764-33b9-47dc-95ea-b689a8cf14e2', 'c59442d7-4741-4c9b-ae00-09bd0b1f1bb7', '1d273d27-4049-4f52-9657-a1c69a57a074', 'c4fc6e72-1191-4378-aaf1-2ec44ab9efd6'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:19 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:05:19 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:19 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:05:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c30e0742-88cb-42dc-a6af-11b1eeead17b tempest-GroupsTest-1096244990 None] Delete group completed successfully. Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Created reservations ['48184b86-9ca6-4231-81b5-ed0a60f39f95'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:19 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:05:19 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:20 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.302s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:20 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:05:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-395ffae3-07d7-4902-be48-05eb663c3ba5 tempest-GroupsTest-1096244990 None] Delete group completed successfully. Jul 17 07:05:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8bab8b67-cf2f-4762-9783-309fcfd5e295 tempest-GroupsTest-1096244990 None] Group tempest-GroupsTest-Group-1619711429: creating Jul 17 07:05:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8bab8b67-cf2f-4762-9783-309fcfd5e295 tempest-GroupsTest-1096244990 None] Group tempest-GroupsTest-Group-1619711429: created successfully Jul 17 07:05:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8bab8b67-cf2f-4762-9783-309fcfd5e295 tempest-GroupsTest-1096244990 None] Create group completed successfully. Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Flow 'volume_create_manager' (df297041-8ca1-43c3-9834-987cfe026e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e9b59d-c3a2-4236-a631-54551de9cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e9b59d-c3a2-4236-a631-54551de9cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1702220742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d19193bd-9d04-4abd-acb3-125f52f41767,host='devstack@QuobyteHD#QuobyteHD',id=d25a41d6-b94e-4eb0-9140-8041604129ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a19a53ddc444598e536b02ae680fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:24Z,use_quota=True,user_id='4478ed7f535f467db971c38954638926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a6ca441-49b1-4349-864f-79fb354a3d8d),volume_type_id=3a6ca441-49b1-4349-864f-79fb354a3d8d)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4871929b-9fc4-4c3f-9fa4-bd0fb392d916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4871929b-9fc4-4c3f-9fa4-bd0fb392d916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638afbfa-af63-4463-8c5b-c1c579ef6e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638afbfa-af63-4463-8c5b-c1c579ef6e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25a41d6-b94e-4eb0-9140-8041604129ef', 'volume_name': 'volume-d25a41d6-b94e-4eb0-9140-8041604129ef', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cd421a-7618-4e2b-9425-63fe7cd06f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cd421a-7618-4e2b-9425-63fe7cd06f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3582ae-7a85-484b-84ff-678fa4cb9133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:24 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Volume d25a41d6-b94e-4eb0-9140-8041604129ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25a41d6-b94e-4eb0-9140-8041604129ef', 'volume_size': 1} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d19193bd-9d04-4abd-acb3-125f52f41767,created_at=2026-07-17T05:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1702220742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d19193bd-9d04-4abd-acb3-125f52f41767,host='devstack@QuobyteHD#QuobyteHD',id=d25a41d6-b94e-4eb0-9140-8041604129ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a19a53ddc444598e536b02ae680fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:24Z,use_quota=True,user_id='4478ed7f535f467db971c38954638926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a6ca441-49b1-4349-864f-79fb354a3d8d),volume_type_id=3a6ca441-49b1-4349-864f-79fb354a3d8d)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Creating volume d25a41d6-b94e-4eb0-9140-8041604129ef {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:05:24 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:24 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef 1073741824 Jul 17 07:05:24 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:24 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef 1073741824" returned: 0 in 0.582s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:24 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef Jul 17 07:05:24 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:25 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef" returned: 0 in 0.375s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3582ae-7a85-484b-84ff-678fa4cb9133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25a41d6-b94e-4eb0-9140-8041604129ef', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e96428d-330a-4c9d-a3eb-474593586326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:25 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Volume volume-d25a41d6-b94e-4eb0-9140-8041604129ef (d25a41d6-b94e-4eb0-9140-8041604129ef): created successfully Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e96428d-330a-4c9d-a3eb-474593586326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Flow 'volume_create_manager' (df297041-8ca1-43c3-9834-987cfe026e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-72a97162-0f16-4eb4-9368-85d9d302321e tempest-GroupsTest-1096244990 None] Created volume successfully. Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Acquiring lock "cinder-afffb600-70a9-47f2-aafa-24ecba29885e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Lock "cinder-afffb600-70a9-47f2-aafa-24ecba29885e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Acquiring lock "cinder-quobyte-afffb600-70a9-47f2-aafa-24ecba29885e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Lock "cinder-quobyte-afffb600-70a9-47f2-aafa-24ecba29885e" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Flow 'volume_create_manager' (08b63ddd-13e3-46e2-82e0-9e5f799d1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6de0f9-e371-4983-9072-ad4053383f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6facb-5654-43d2-922f-5e350a238748]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6de0f9-e371-4983-9072-ad4053383f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100264138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d19193bd-9d04-4abd-acb3-125f52f41767,host='devstack@QuobyteHD#QuobyteHD',id=e8337fd9-b6b4-40b6-8d43-709237483ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a19a53ddc444598e536b02ae680fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:27Z,use_quota=True,user_id='4478ed7f535f467db971c38954638926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a6ca441-49b1-4349-864f-79fb354a3d8d),volume_type_id=3a6ca441-49b1-4349-864f-79fb354a3d8d)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acd4581-40cd-4415-a1eb-46b0365a92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acd4581-40cd-4415-a1eb-46b0365a92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0768d3-cf50-49e0-8ba3-dfe635140268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0768d3-cf50-49e0-8ba3-dfe635140268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8337fd9-b6b4-40b6-8d43-709237483ac9', 'volume_name': 'volume-e8337fd9-b6b4-40b6-8d43-709237483ac9', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b313399-0ab5-4195-bd3b-b46b58e8b003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b313399-0ab5-4195-bd3b-b46b58e8b003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7181fa-c0a1-4024-ab7d-ee94532923ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:26 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Volume e8337fd9-b6b4-40b6-8d43-709237483ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8337fd9-b6b4-40b6-8d43-709237483ac9', 'volume_size': 1} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d19193bd-9d04-4abd-acb3-125f52f41767,created_at=2026-07-17T05:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100264138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d19193bd-9d04-4abd-acb3-125f52f41767,host='devstack@QuobyteHD#QuobyteHD',id=e8337fd9-b6b4-40b6-8d43-709237483ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a19a53ddc444598e536b02ae680fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:27Z,use_quota=True,user_id='4478ed7f535f467db971c38954638926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a6ca441-49b1-4349-864f-79fb354a3d8d),volume_type_id=3a6ca441-49b1-4349-864f-79fb354a3d8d)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Creating volume e8337fd9-b6b4-40b6-8d43-709237483ac9 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:05:26 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:05:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:27 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 1073741824 Jul 17 07:05:27 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:27 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:05:27 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Flow 'volume_create_manager' (f14918ac-f2ce-4593-9a34-f13c7143b2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3719b8fe-69f2-4ea9-aa11-f84847d346af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3719b8fe-69f2-4ea9-aa11-f84847d346af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-470922964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0eb7a0-8fda-411e-a107-d95128a567e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a53d52af21446e9b74983d655d20f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:27Z,use_quota=True,user_id='4e6a0f07f3ef439fa18dff02b5bb2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa565b9-55d0-4f3c-ad00-55f12350f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa565b9-55d0-4f3c-ad00-55f12350f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b584e63f-c171-4f90-9564-0d9592100b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b584e63f-c171-4f90-9564-0d9592100b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec0eb7a0-8fda-411e-a107-d95128a567e4', 'volume_name': 'volume-ec0eb7a0-8fda-411e-a107-d95128a567e4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21022260-f324-4c8c-82b3-d48dd8b3f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21022260-f324-4c8c-82b3-d48dd8b3f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c99718-a2c5-4cbf-8b2c-9c742d39b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:27 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Volume ec0eb7a0-8fda-411e-a107-d95128a567e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec0eb7a0-8fda-411e-a107-d95128a567e4', 'volume_size': 1} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:27 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e" returned: 0 in 0.392s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:27 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e Jul 17 07:05:27 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:27 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 1073741824" returned: 0 in 0.457s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:27 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 Jul 17 07:05:27 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:27 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-afffb600-70a9-47f2-aafa-24ecba29885e" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Lock "cinder-quobyte-afffb600-70a9-47f2-aafa-24ecba29885e" released by "delete_volume" :: held 0.747s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Created reservations ['5d3c527a-0f64-450d-a3aa-77b2538d3f9f', '2542a681-a17a-4309-be52-5edb41a0bcf7', '8dad589d-2a2a-49e9-a73d-6391cb1cea28', 'e6f9f9e3-7122-4bc5-a80f-e3d656d4c82b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:27 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:05:27 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:27 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-470922964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0eb7a0-8fda-411e-a107-d95128a567e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a53d52af21446e9b74983d655d20f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:27Z,use_quota=True,user_id='4e6a0f07f3ef439fa18dff02b5bb2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Creating volume ec0eb7a0-8fda-411e-a107-d95128a567e4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:05:27 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7181fa-c0a1-4024-ab7d-ee94532923ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8337fd9-b6b4-40b6-8d43-709237483ac9', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecaaf62-7bc0-43ef-8792-9c8c0ce1cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:27 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Volume volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 (e8337fd9-b6b4-40b6-8d43-709237483ac9): created successfully Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecaaf62-7bc0-43ef-8792-9c8c0ce1cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:27 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 1073741824 Jul 17 07:05:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Flow 'volume_create_manager' (08b63ddd-13e3-46e2-82e0-9e5f799d1972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:27 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:27 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-834edefc-5cdd-4477-bc9a-d4372efee248 tempest-GroupsTest-1096244990 None] Created volume successfully. Jul 17 07:05:28 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.339s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:05:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Deleted volume successfully. Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6b7f2e4e-5f07-4575-8c0f-1e5255cc5bce tempest-TaggedAttachmentsTest-280738593 None] Lock "cinder-afffb600-70a9-47f2-aafa-24ecba29885e-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:05:28 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 1073741824" returned: 0 in 0.585s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:28 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 Jul 17 07:05:28 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:28 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4" returned: 0 in 0.347s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c99718-a2c5-4cbf-8b2c-9c742d39b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec0eb7a0-8fda-411e-a107-d95128a567e4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a65ca5-7996-40dc-b4ec-5ffe0680f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Volume volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 (ec0eb7a0-8fda-411e-a107-d95128a567e4): created successfully Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a65ca5-7996-40dc-b4ec-5ffe0680f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Flow 'volume_create_manager' (f14918ac-f2ce-4593-9a34-f13c7143b2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-356f3e2d-a5ea-471b-aa1c-82985c86e8e8 tempest-AttachVolumeNegativeTest-1246012281 None] Created volume successfully. Jul 17 07:05:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-354a7b04-8c9f-44a8-96bc-a5f7d3342d52 tempest-GroupsTest-1096244990 None] Update group completed successfully. Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:29 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:05:29 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:30 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.309s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:05:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:05:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 8 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:05:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:05:30 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-59af6d7d-5767-4340-bbdb-3186b8b6df3a tempest-GroupsTest-1096244990 None] Update group completed successfully. Jul 17 07:05:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-afb635d8-1d95-4130-9d0f-60faaac2a949 req-df1a4773-4677-4d74-acda-8c4ef1608a36 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-afb635d8-1d95-4130-9d0f-60faaac2a949 req-df1a4773-4677-4d74-acda-8c4ef1608a36 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-afb635d8-1d95-4130-9d0f-60faaac2a949 req-df1a4773-4677-4d74-acda-8c4ef1608a36 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-afb635d8-1d95-4130-9d0f-60faaac2a949 req-df1a4773-4677-4d74-acda-8c4ef1608a36 tempest-AttachVolumeNegativeTest-1246012281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-ec0eb7a0-8fda-411e-a107-d95128a567e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fc8c690-7671-41c6-91d5-023e6228a860', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:05:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-afb635d8-1d95-4130-9d0f-60faaac2a949 req-df1a4773-4677-4d74-acda-8c4ef1608a36 tempest-AttachVolumeNegativeTest-1246012281 None] attachment_update completed successfully. Jul 17 07:05:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Acquiring lock "cinder-quobyte-d25a41d6-b94e-4eb0-9140-8041604129ef" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:05:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Lock "cinder-quobyte-d25a41d6-b94e-4eb0-9140-8041604129ef" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:05:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cd9c16-8dcf-4988-9e5b-fada5aa07514]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:33 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef Jul 17 07:05:33 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:33 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef" returned: 0 in 0.558s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:33 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef Jul 17 07:05:33 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:34 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d25a41d6-b94e-4eb0-9140-8041604129ef" returned: 0 in 0.588s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Lock "cinder-quobyte-d25a41d6-b94e-4eb0-9140-8041604129ef" released by "delete_volume" :: held 1.242s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Acquiring lock "cinder-quobyte-e8337fd9-b6b4-40b6-8d43-709237483ac9" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Lock "cinder-quobyte-e8337fd9-b6b4-40b6-8d43-709237483ac9" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1db5e-a5da-4fd4-b54a-4fb38a80362d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:34 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 Jul 17 07:05:34 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-1906b9f1-b832-446a-ae68-6d144b5902e6 req-8aac0fa3-6583-46da-aa26-0c12d1b17048 tempest-AttachVolumeNegativeTest-1246012281 None] Terminate volume connection completed successfully. Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-1906b9f1-b832-446a-ae68-6d144b5902e6 req-8aac0fa3-6583-46da-aa26-0c12d1b17048 tempest-AttachVolumeNegativeTest-1246012281 None] Deleting attachment 4fc8c690-7671-41c6-91d5-023e6228a860. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:05:34 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9" returned: 0 in 0.525s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:34 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9 Jul 17 07:05:34 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:35 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e8337fd9-b6b4-40b6-8d43-709237483ac9" returned: 0 in 0.384s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Lock "cinder-quobyte-e8337fd9-b6b4-40b6-8d43-709237483ac9" released by "delete_volume" :: held 0.976s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Created reservations ['0c022fa5-434d-4e4a-a5d1-7a30b1e55ec5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:35 devstack cinder-volume[87331]: WARNING cinder.quota [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2131256847 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2131256847, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:05:35 devstack cinder-volume[87331]: WARNING cinder.quota [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2131256847 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2131256847, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Created reservations ['38b4a8f7-c8c8-4f03-95f0-309ffdbcd7ed', '25f9ad5b-2c75-4ac9-8288-76f411159bd3', '626fa516-5961-46f8-b4c2-aa44c97ca8a2', '091171d6-bebc-4c62-83b4-beee81045650'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Created reservations ['96d4fef1-870a-4e9e-9ec9-cc2ffd8a0352', 'a2e589ae-4267-4f57-9a79-dc4a88b709a8', '7674c48c-73ae-4587-a168-dd32b1d863ca', '25de7df6-665a-4e13-a533-c22ebaabfc26'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:35 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:05:35 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:36 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.590s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:36 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:05:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4a97cc39-fd5a-4813-83fa-0f46a7c12a09 tempest-GroupsTest-1096244990 None] Delete group completed successfully. Jul 17 07:05:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-62578458-b671-43ce-813e-ad86a5731938 tempest-GroupsV314Test-1441807685 None] Group tempest-GroupsV314Test-Group-1422280548: creating Jul 17 07:05:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-62578458-b671-43ce-813e-ad86a5731938 tempest-GroupsV314Test-1441807685 None] Group tempest-GroupsV314Test-Group-1422280548: created successfully Jul 17 07:05:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-62578458-b671-43ce-813e-ad86a5731938 tempest-GroupsV314Test-1441807685 None] Create group completed successfully. Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Flow 'volume_create_manager' (8b7b5751-5ae1-4b29-bc3c-3e2ccd71f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3b0efb-8b89-4e40-916f-af84b7911810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3b0efb-8b89-4e40-916f-af84b7911810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833864319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30fdcf21-a71e-4a59-be69-f633e02b76e7,host='devstack@QuobyteHD#QuobyteHD',id=98ef9a7e-b192-4e62-85e9-8964d4c141b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c48269e0098414c982a1781da078a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:45Z,use_quota=True,user_id='c486532f27564abcb0999b6bb7383b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(924cd99f-09c3-4948-a6d5-2b8fe12b2e83),volume_type_id=924cd99f-09c3-4948-a6d5-2b8fe12b2e83)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cea1693-9ec2-4816-adeb-ab2e2029e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cea1693-9ec2-4816-adeb-ab2e2029e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b26d90b-9b0c-4292-bb6d-0c41de422742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b26d90b-9b0c-4292-bb6d-0c41de422742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ef9a7e-b192-4e62-85e9-8964d4c141b2', 'volume_name': 'volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f31f4-bf0f-44e6-ac85-0f2512174a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f31f4-bf0f-44e6-ac85-0f2512174a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadd7d66-cf15-4b97-828a-c36cf9ce7277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Volume 98ef9a7e-b192-4e62-85e9-8964d4c141b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2', 'volume_size': 1} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30fdcf21-a71e-4a59-be69-f633e02b76e7,created_at=2026-07-17T05:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833864319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30fdcf21-a71e-4a59-be69-f633e02b76e7,host='devstack@QuobyteHD#QuobyteHD',id=98ef9a7e-b192-4e62-85e9-8964d4c141b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c48269e0098414c982a1781da078a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:05:45Z,use_quota=True,user_id='c486532f27564abcb0999b6bb7383b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(924cd99f-09c3-4948-a6d5-2b8fe12b2e83),volume_type_id=924cd99f-09c3-4948-a6d5-2b8fe12b2e83)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Creating volume 98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:05:45 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:45 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 1073741824 Jul 17 07:05:45 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:45 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 1073741824" returned: 0 in 0.632s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:46 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:05:46 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:46 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.449s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadd7d66-cf15-4b97-828a-c36cf9ce7277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ab14fc-8527-41a9-9f4c-2bdb5d18cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:05:46 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Volume volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 (98ef9a7e-b192-4e62-85e9-8964d4c141b2): created successfully Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ab14fc-8527-41a9-9f4c-2bdb5d18cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:05:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Flow 'volume_create_manager' (8b7b5751-5ae1-4b29-bc3c-3e2ccd71f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:05:46 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-56bbf232-841e-43d6-bcc6-b49f1f2259a2 tempest-GroupsV314Test-1441807685 None] Created volume successfully. Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:48 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Cloning volume 98ef9a7e-b192-4e62-85e9-8964d4c141b2 to volume 59871dce-0793-4b07-a560-18057b3c69e9 Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Creating offline snapshot c5b62d40-f999-4efc-814c-62fbef200e51 of volume 98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c044d-ee16-430b-a118-fbdab94e05f2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:48 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:05:48 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:48 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:48 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 1G Jul 17 07:05:48 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:49 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 1G" returned: 0 in 0.497s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:49 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 Jul 17 07:05:49 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:49 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51" returned: 0 in 0.350s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:49 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:05:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:49 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 Jul 17 07:05:49 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:50 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51" returned: 0 in 0.427s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:50 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info Jul 17 07:05:50 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:50 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info" returned: 0 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:50 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:50 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info Jul 17 07:05:50 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:50 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.info" returned: 0 in 0.401s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Acquiring lock "cinder-quobyte-59871dce-0793-4b07-a560-18057b3c69e9" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-59871dce-0793-4b07-a560-18057b3c69e9" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:05:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] snapshot: c5b62d40-f999-4efc-814c-62fbef200e51, volume: 59871dce-0793-4b07-a560-18057b3c69e9, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f687998d-ed00-4177-9a01-bf02531ada2c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:51 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 Jul 17 07:05:51 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:51 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51" returned: 0 in 0.748s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b02d3c-736a-4782-b83d-62cd2114738d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:05:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:51 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:05:51 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:05:52 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 17 07:05:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.576s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:05:52 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:05:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:05:52 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 Jul 17 07:05:52 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:00 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=64,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:06:00 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=76,cinder:UPDATE=64,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:06:00 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9" returned: 0 in 8.056s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c311869c-41f2-45ec-9dbe-114c3f0f0ff3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:00 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:06:00 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:01 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.963s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:01 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:06:01 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Converted 1024.00 MB image at 127.09 MB/s Jul 17 07:06:01 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:06:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:01 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 Jul 17 07:06:01 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:02 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9" returned: 0 in 0.602s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-59871dce-0793-4b07-a560-18057b3c69e9" released by "_copy_volume_from_snapshot" :: held 11.100s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Acquiring lock "cinder-quobyte-c5b62d40-f999-4efc-814c-62fbef200e51" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-c5b62d40-f999-4efc-814c-62fbef200e51" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Deleting offline snapshot c5b62d40-f999-4efc-814c-62fbef200e51 of volume 98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] snapshot_file for this snap is: volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[af200c98-e1d5-4e64-86e0-45373273638d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:02 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 Jul 17 07:06:02 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:02 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51" returned: 0 in 0.665s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ade56-47aa-4d83-a95d-2423d454ad0a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:03 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:06:03 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:03 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.733s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:03 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 Jul 17 07:06:03 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:04 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51" returned: 0 in 0.602s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:04 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51 Jul 17 07:06:04 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:04 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2.c5b62d40-f999-4efc-814c-62fbef200e51" returned: 0 in 0.461s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-c5b62d40-f999-4efc-814c-62fbef200e51" released by "_delete_snapshot" :: held 2.592s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.442s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:04 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-87e28feb-2144-492d-930c-41418da6dabb tempest-GroupsV314Test-1441807685 None] Create group from source-group-30fdcf21-a71e-4a59-be69-f633e02b76e7 completed successfully. Jul 17 07:06:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Acquiring lock "cinder-quobyte-59871dce-0793-4b07-a560-18057b3c69e9" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-59871dce-0793-4b07-a560-18057b3c69e9" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ecad1e-95de-40c9-b450-78ad6a17bac5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:06 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 Jul 17 07:06:06 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:07 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9" returned: 0 in 0.432s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:07 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9 Jul 17 07:06:07 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:07 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59871dce-0793-4b07-a560-18057b3c69e9" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-59871dce-0793-4b07-a560-18057b3c69e9" released by "delete_volume" :: held 0.779s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Created reservations ['1cd8f8db-5415-46f5-958c-88f881b4cfd9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:07 devstack cinder-volume[87331]: WARNING cinder.quota [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1564598436 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1564598436, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:06:07 devstack cinder-volume[87331]: WARNING cinder.quota [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1564598436 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1564598436, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Created reservations ['4411b152-aa53-446f-8372-e7430cb6a20f', 'fcb36728-cb16-40ce-8314-810a51565fba', 'b36c9ecc-53d9-4ec9-9b96-26f6e7d4e17b', '3882fe4b-0a8d-4728-9b59-b3d91856b9d7'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:07 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:07 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:07 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:07 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-35e87729-6123-4909-bda9-174ea77caf36 tempest-GroupsV314Test-1441807685 None] Delete group completed successfully. Jul 17 07:06:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Acquiring lock "cinder-quobyte-98ef9a7e-b192-4e62-85e9-8964d4c141b2" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-98ef9a7e-b192-4e62-85e9-8964d4c141b2" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:08 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e6a1c-be90-46f8-ae1e-6cd9e879bc84]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:08 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:06:08 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:08 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.421s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:08 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2 Jul 17 07:06:08 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:09 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98ef9a7e-b192-4e62-85e9-8964d4c141b2" returned: 0 in 0.450s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Lock "cinder-quobyte-98ef9a7e-b192-4e62-85e9-8964d4c141b2" released by "delete_volume" :: held 1.011s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Created reservations ['057d2cb4-2565-4d80-9ce2-c2513d5ce856'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Created reservations ['5e217405-05e2-4a1f-a2e5-75d072474982', '8dcf4cf9-8992-4a2d-9c29-1803708958bb', '97ea5c33-b36e-4ebf-b7c2-027c494a4d2f', '4f0e18b2-06c6-40ff-b2ab-05760c017c71'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:09 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:09 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:10 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.381s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:10 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2d14f032-eef8-4a25-ad70-c8c6fa791163 tempest-GroupsV314Test-1441807685 None] Delete group completed successfully. Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Flow 'volume_create_manager' (03952d9b-0e6a-49ec-b34f-b213ce9ee93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f95bd6-9429-477a-898f-184ac009b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f95bd6-9429-477a-898f-184ac009b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2145943210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bba284-2249-408c-be39-caf16f2f68af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a53d52af21446e9b74983d655d20f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:15Z,use_quota=True,user_id='4e6a0f07f3ef439fa18dff02b5bb2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585abc16-6b3f-47a9-8f7f-82ced7ec0c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585abc16-6b3f-47a9-8f7f-82ced7ec0c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b128ca6-6926-4516-9acc-9ab9113dce5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b128ca6-6926-4516-9acc-9ab9113dce5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bba284-2249-408c-be39-caf16f2f68af', 'volume_name': 'volume-42bba284-2249-408c-be39-caf16f2f68af', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff99f46e-558d-4a91-b9ae-1082c45664e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff99f46e-558d-4a91-b9ae-1082c45664e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d480539-c985-40ae-9b20-d3d10dedf20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Volume 42bba284-2249-408c-be39-caf16f2f68af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bba284-2249-408c-be39-caf16f2f68af', 'volume_size': 1} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2145943210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bba284-2249-408c-be39-caf16f2f68af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a53d52af21446e9b74983d655d20f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:15Z,use_quota=True,user_id='4e6a0f07f3ef439fa18dff02b5bb2c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Creating volume 42bba284-2249-408c-be39-caf16f2f68af {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:15 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:15 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af 1073741824 Jul 17 07:06:15 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:16 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af 1073741824" returned: 0 in 1.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:17 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af Jul 17 07:06:17 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:17 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af" returned: 0 in 0.781s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d480539-c985-40ae-9b20-d3d10dedf20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bba284-2249-408c-be39-caf16f2f68af', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fed392-97bc-4dff-be4c-2968028e0494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Volume volume-42bba284-2249-408c-be39-caf16f2f68af (42bba284-2249-408c-be39-caf16f2f68af): created successfully Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fed392-97bc-4dff-be4c-2968028e0494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Flow 'volume_create_manager' (03952d9b-0e6a-49ec-b34f-b213ce9ee93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b87ef30c-2b38-4f1a-aa40-6193cc5a4f18 tempest-AttachVolumeNegativeTest-1246012281 None] Created volume successfully. Jul 17 07:06:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b054e6bb-5fd5-47ce-9bee-e14991198947 req-a1212627-4aeb-4aaa-9f78-9df35d7765ae tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b054e6bb-5fd5-47ce-9bee-e14991198947 req-a1212627-4aeb-4aaa-9f78-9df35d7765ae tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b054e6bb-5fd5-47ce-9bee-e14991198947 req-a1212627-4aeb-4aaa-9f78-9df35d7765ae tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-b054e6bb-5fd5-47ce-9bee-e14991198947 req-a1212627-4aeb-4aaa-9f78-9df35d7765ae tempest-AttachVolumeNegativeTest-1246012281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-42bba284-2249-408c-be39-caf16f2f68af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5349bfe-16f7-4c8f-9798-ad579c3786b6', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:06:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-b054e6bb-5fd5-47ce-9bee-e14991198947 req-a1212627-4aeb-4aaa-9f78-9df35d7765ae tempest-AttachVolumeNegativeTest-1246012281 None] attachment_update completed successfully. Jul 17 07:06:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-e1f0b1d4-dfa5-47b7-91ea-5aa444ffd9be req-bf5202b6-6d75-4006-9d99-fcea921aceb7 tempest-AttachVolumeNegativeTest-1246012281 None] Terminate volume connection completed successfully. Jul 17 07:06:23 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-e1f0b1d4-dfa5-47b7-91ea-5aa444ffd9be req-bf5202b6-6d75-4006-9d99-fcea921aceb7 tempest-AttachVolumeNegativeTest-1246012281 None] Deleting attachment b5349bfe-16f7-4c8f-9798-ad579c3786b6. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Flow 'volume_create_manager' (e1ab43ba-aaa5-42f9-a577-ec4c17d7161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c29f10-46b9-4719-a3be-39fcafc08a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c29f10-46b9-4719-a3be-39fcafc08a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-555104070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e372b1f-d03f-43c2-9699-fe5ed7307bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b86bd2f1d6342de8961035bcf9ab29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:24Z,use_quota=True,user_id='698fcaafec044fa3a419954b16cb0522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6758319b-5f80-4068-8dea-a5580d68f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6758319b-5f80-4068-8dea-a5580d68f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25003c7f-40d0-4d26-933d-10db96e5b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25003c7f-40d0-4d26-933d-10db96e5b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e372b1f-d03f-43c2-9699-fe5ed7307bb6', 'volume_name': 'volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82006301-0307-44f0-80e5-6d28651febfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82006301-0307-44f0-80e5-6d28651febfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd185d8-eb77-415b-8ee2-645410beea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:24 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Volume 1e372b1f-d03f-43c2-9699-fe5ed7307bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6', 'volume_size': 1} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-555104070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e372b1f-d03f-43c2-9699-fe5ed7307bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b86bd2f1d6342de8961035bcf9ab29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:24Z,use_quota=True,user_id='698fcaafec044fa3a419954b16cb0522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Creating volume 1e372b1f-d03f-43c2-9699-fe5ed7307bb6 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:24 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:24 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 1073741824 Jul 17 07:06:24 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:24 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 1073741824" returned: 0 in 0.753s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:25 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 Jul 17 07:06:25 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:25 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6" returned: 0 in 0.512s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd185d8-eb77-415b-8ee2-645410beea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad6aa68-f413-4ce9-a1e4-1027e136c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:25 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Volume volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 (1e372b1f-d03f-43c2-9699-fe5ed7307bb6): created successfully Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad6aa68-f413-4ce9-a1e4-1027e136c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Flow 'volume_create_manager' (e1ab43ba-aaa5-42f9-a577-ec4c17d7161b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-712c835c-3730-4c76-984e-9366be780af4 tempest-VolumeQuotasAdminTestJSON-58414651 None] Created volume successfully. Jul 17 07:06:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "cinder-1e372b1f-d03f-43c2-9699-fe5ed7307bb6-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "cinder-1e372b1f-d03f-43c2-9699-fe5ed7307bb6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "cinder-quobyte-1e372b1f-d03f-43c2-9699-fe5ed7307bb6" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "cinder-quobyte-1e372b1f-d03f-43c2-9699-fe5ed7307bb6" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9ad9f6-61a6-47e6-9f6b-8f29794c30b9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:26 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 Jul 17 07:06:26 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:27 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6" returned: 0 in 0.477s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:27 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6 Jul 17 07:06:27 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:27 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1e372b1f-d03f-43c2-9699-fe5ed7307bb6" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "cinder-quobyte-1e372b1f-d03f-43c2-9699-fe5ed7307bb6" released by "delete_volume" :: held 0.812s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Created reservations ['69995e8e-6f13-4837-a95c-be6b61baff3e', 'e3c5f1a2-143d-4337-919f-1dc0e3a0aa2b', 'e66afd99-a7ae-4cd8-9c1f-f38b2202da40', 'c965c3da-14fb-4bef-9094-466cbccff5ad'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:27 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:27 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:27 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.436s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Deleted volume successfully. Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d1bdef2-29a0-4800-b977-2906f815f7b8 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "cinder-1e372b1f-d03f-43c2-9699-fe5ed7307bb6-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Flow 'volume_create_manager' (ee3a7535-d32b-4e61-be1e-09760a18bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767ad1cf-b692-4087-8749-39ccd91c0c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767ad1cf-b692-4087-8749-39ccd91c0c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706641956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1094462b-dfc3-4949-9690-ff13d9629e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b86bd2f1d6342de8961035bcf9ab29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:28Z,use_quota=True,user_id='698fcaafec044fa3a419954b16cb0522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b370aed9-0f9d-49f8-8bd8-9b63527006a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b370aed9-0f9d-49f8-8bd8-9b63527006a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d68c362-2186-4a06-9965-c047c6f32fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d68c362-2186-4a06-9965-c047c6f32fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1094462b-dfc3-4949-9690-ff13d9629e15', 'volume_name': 'volume-1094462b-dfc3-4949-9690-ff13d9629e15', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37e8f2e-e19e-477d-b52f-ab678afa8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37e8f2e-e19e-477d-b52f-ab678afa8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0eb534-d9d3-4162-85ef-7f2b711ee9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Volume 1094462b-dfc3-4949-9690-ff13d9629e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1094462b-dfc3-4949-9690-ff13d9629e15', 'volume_size': 1} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706641956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1094462b-dfc3-4949-9690-ff13d9629e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b86bd2f1d6342de8961035bcf9ab29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:28Z,use_quota=True,user_id='698fcaafec044fa3a419954b16cb0522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Creating volume 1094462b-dfc3-4949-9690-ff13d9629e15 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:28 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:28 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 1073741824 Jul 17 07:06:28 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "cinder-42bba284-2249-408c-be39-caf16f2f68af-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-42bba284-2249-408c-be39-caf16f2f68af-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "cinder-quobyte-42bba284-2249-408c-be39-caf16f2f68af" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-quobyte-42bba284-2249-408c-be39-caf16f2f68af" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d536269-06cc-4045-8394-de5fbe31483f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:28 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af Jul 17 07:06:28 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:29 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 1073741824" returned: 0 in 0.514s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:29 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 Jul 17 07:06:29 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:29 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:29 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af Jul 17 07:06:29 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:29 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15" returned: 0 in 0.272s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0eb534-d9d3-4162-85ef-7f2b711ee9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1094462b-dfc3-4949-9690-ff13d9629e15', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b988c5f-0fa9-4160-ba7d-a7bef2cafc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:29 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Volume volume-1094462b-dfc3-4949-9690-ff13d9629e15 (1094462b-dfc3-4949-9690-ff13d9629e15): created successfully Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b988c5f-0fa9-4160-ba7d-a7bef2cafc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Flow 'volume_create_manager' (ee3a7535-d32b-4e61-be1e-09760a18bba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f64f7f5f-e6f8-4d81-a457-92eeb9793629 tempest-VolumeQuotasAdminTestJSON-58414651 None] Created volume successfully. Jul 17 07:06:29 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-42bba284-2249-408c-be39-caf16f2f68af" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-quobyte-42bba284-2249-408c-be39-caf16f2f68af" released by "delete_volume" :: held 0.707s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Created reservations ['c1d623ff-7d15-49a0-b126-a593d1b436bb', 'b1aaaffd-3d2f-4c64-b281-d2ab12387e63', '99967e76-56ce-4d98-b713-8f66a5c2f6db', '4d306a8d-ae98-4478-8923-b5f1dcbf536c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:29 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:29 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:29 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Deleted volume successfully. Jul 17 07:06:29 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:29 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80e547e0-8bd0-4a98-9d44-536e321e839a tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-42bba284-2249-408c-be39-caf16f2f68af-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "cinder-ec0eb7a0-8fda-411e-a107-d95128a567e4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-ec0eb7a0-8fda-411e-a107-d95128a567e4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "cinder-quobyte-ec0eb7a0-8fda-411e-a107-d95128a567e4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-quobyte-ec0eb7a0-8fda-411e-a107-d95128a567e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e0305a-cfae-483b-97a8-cedfe8aae7af]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:30 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.299s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 8 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:06:30 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 Jul 17 07:06:30 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:30 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4" returned: 0 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:30 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4 Jul 17 07:06:30 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:30 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ec0eb7a0-8fda-411e-a107-d95128a567e4" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-quobyte-ec0eb7a0-8fda-411e-a107-d95128a567e4" released by "delete_volume" :: held 0.690s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Created reservations ['c53d10af-26ad-439a-a896-a99f811916f5', '0167821a-d3be-4162-8dc5-c49cc919676a', 'ed7376bc-3ada-4bf6-bdbb-5eff2fdb3159', '9a02210f-115e-436b-b5ee-ae39981c8489'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:30 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:30 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-49e1ba10-9a60-44c6-b1d3-3409a464696a tempest-VolumeQuotasAdminTestJSON-1965939889 None] Transfer volume completed successfully. Jul 17 07:06:31 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.332s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Deleted volume successfully. Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4307af20-29e9-4033-b64d-5f94c693e8a4 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-ec0eb7a0-8fda-411e-a107-d95128a567e4-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "cinder-58025110-830d-4326-9c5c-061aff1685fb-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-58025110-830d-4326-9c5c-061aff1685fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "cinder-quobyte-58025110-830d-4326-9c5c-061aff1685fb" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-quobyte-58025110-830d-4326-9c5c-061aff1685fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[87316000-216a-40df-bdda-a0c11b856f00]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:31 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb Jul 17 07:06:31 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Acquiring lock "cinder-1094462b-dfc3-4949-9690-ff13d9629e15-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Lock "cinder-1094462b-dfc3-4949-9690-ff13d9629e15-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Acquiring lock "cinder-quobyte-1094462b-dfc3-4949-9690-ff13d9629e15" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Lock "cinder-quobyte-1094462b-dfc3-4949-9690-ff13d9629e15" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff6fabe-930c-490b-aabc-f94a91faeacf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:32 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb" returned: 0 in 0.617s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:32 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb Jul 17 07:06:32 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 Jul 17 07:06:32 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:32 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:32 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-58025110-830d-4326-9c5c-061aff1685fb" returned: 0 in 0.407s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:32 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-quobyte-58025110-830d-4326-9c5c-061aff1685fb" released by "delete_volume" :: held 1.082s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15" returned: 0 in 0.570s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:32 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15 Jul 17 07:06:32 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Created reservations ['47c7bdee-ef8b-477b-a567-2a1ee6ed429a', '1bfa1d10-2acb-4d4c-8af2-850bc755e856', '441c436f-6339-4ac1-89df-788698b0e2c1', 'b583acbd-f9da-4937-aa33-11cff51b48bc'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:32 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:32 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:32 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1094462b-dfc3-4949-9690-ff13d9629e15" returned: 0 in 0.331s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Lock "cinder-quobyte-1094462b-dfc3-4949-9690-ff13d9629e15" released by "delete_volume" :: held 0.987s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Created reservations ['b2f72d4b-480a-44bb-862b-5cf3beea796b', 'cc9c44d3-d715-4619-b383-2fe832522c5f', '4a652b33-54bc-4556-8677-166390224245', 'ef8115ff-0b72-4322-b448-04202444ad63'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:33 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.379s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Deleted volume successfully. Jul 17 07:06:33 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:33 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ced3573c-b31f-47b0-b549-2389f0f2ad23 tempest-AttachVolumeNegativeTest-1246012281 None] Lock "cinder-58025110-830d-4326-9c5c-061aff1685fb-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:33 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.318s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Deleted volume successfully. Jul 17 07:06:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3bcaa2b0-5130-4679-b137-595a8aeb8271 tempest-VolumeQuotasAdminTestJSON-1538643891 None] Lock "cinder-1094462b-dfc3-4949-9690-ff13d9629e15-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Flow 'volume_create_manager' (7f492d1a-5ddb-423e-aa0e-e846c19d2c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8b0983-1984-4f03-807c-2a7f4b2884dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8b0983-1984-4f03-807c-2a7f4b2884dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1459167132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a80449-0c94-4345-bbca-b9b8b59169d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799ec0313a14882a448b36c88c73301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:36Z,use_quota=True,user_id='9473c096ea36474c806dfaafb486ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cc30d5-2dd9-412e-8b50-795804444631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cc30d5-2dd9-412e-8b50-795804444631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4163676f-2634-4d0c-a796-90fc0803b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4163676f-2634-4d0c-a796-90fc0803b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a80449-0c94-4345-bbca-b9b8b59169d3', 'volume_name': 'volume-76a80449-0c94-4345-bbca-b9b8b59169d3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dded79a-c2e9-40cd-8a8a-8efbe4bf5bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dded79a-c2e9-40cd-8a8a-8efbe4bf5bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1eb21c0-21e2-485e-90d8-221d043fcd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:35 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Volume 76a80449-0c94-4345-bbca-b9b8b59169d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a80449-0c94-4345-bbca-b9b8b59169d3', 'volume_size': 1} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1459167132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a80449-0c94-4345-bbca-b9b8b59169d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799ec0313a14882a448b36c88c73301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:36Z,use_quota=True,user_id='9473c096ea36474c806dfaafb486ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Creating volume 76a80449-0c94-4345-bbca-b9b8b59169d3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:35 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:36 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 1073741824 Jul 17 07:06:36 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:36 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 1073741824" returned: 0 in 0.519s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:36 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 Jul 17 07:06:36 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:36 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1eb21c0-21e2-485e-90d8-221d043fcd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a80449-0c94-4345-bbca-b9b8b59169d3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a58f0-f791-4321-aaa4-c1b996af1ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:36 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Volume volume-76a80449-0c94-4345-bbca-b9b8b59169d3 (76a80449-0c94-4345-bbca-b9b8b59169d3): created successfully Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a58f0-f791-4321-aaa4-c1b996af1ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Flow 'volume_create_manager' (7f492d1a-5ddb-423e-aa0e-e846c19d2c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cbde222c-aa71-4939-80f1-e1018056c435 tempest-AttachVolumeTestJSON-501762225 None] Created volume successfully. Jul 17 07:06:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-441bfa9b-7bac-445a-8e17-5ae14ce61455 req-2a9369aa-3aa6-40e7-9689-27eb75ac1ea8 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-441bfa9b-7bac-445a-8e17-5ae14ce61455 req-2a9369aa-3aa6-40e7-9689-27eb75ac1ea8 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-441bfa9b-7bac-445a-8e17-5ae14ce61455 req-2a9369aa-3aa6-40e7-9689-27eb75ac1ea8 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-441bfa9b-7bac-445a-8e17-5ae14ce61455 req-2a9369aa-3aa6-40e7-9689-27eb75ac1ea8 tempest-AttachVolumeTestJSON-501762225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-76a80449-0c94-4345-bbca-b9b8b59169d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad89e38d-89d3-4dd9-9be1-2741ffd8ee57', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:06:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-441bfa9b-7bac-445a-8e17-5ae14ce61455 req-2a9369aa-3aa6-40e7-9689-27eb75ac1ea8 tempest-AttachVolumeTestJSON-501762225 None] attachment_update completed successfully. Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Flow 'volume_create_manager' (f1e95718-c5b2-48b1-a212-41ea8a4c5528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3de11b-c9f8-4032-bf70-1e98bfaf239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3de11b-c9f8-4032-bf70-1e98bfaf239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-415309561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708b1290-3a21-41a0-b275-467030aa20b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799ec0313a14882a448b36c88c73301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:42Z,use_quota=True,user_id='9473c096ea36474c806dfaafb486ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c25c88-742a-41bc-836c-38b39ac1d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c25c88-742a-41bc-836c-38b39ac1d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431136ec-3d11-4e64-8ace-7f77280694bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431136ec-3d11-4e64-8ace-7f77280694bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708b1290-3a21-41a0-b275-467030aa20b9', 'volume_name': 'volume-708b1290-3a21-41a0-b275-467030aa20b9', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874b72d3-1f60-4b0c-bbdc-ce0799d6d40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874b72d3-1f60-4b0c-bbdc-ce0799d6d40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4244ba-1523-4951-a717-b9bd7ec2bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Volume 708b1290-3a21-41a0-b275-467030aa20b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708b1290-3a21-41a0-b275-467030aa20b9', 'volume_size': 1} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-415309561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708b1290-3a21-41a0-b275-467030aa20b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9799ec0313a14882a448b36c88c73301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:42Z,use_quota=True,user_id='9473c096ea36474c806dfaafb486ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Creating volume 708b1290-3a21-41a0-b275-467030aa20b9 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:41 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:41 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 1073741824 Jul 17 07:06:41 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:42 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 1073741824" returned: 0 in 0.527s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Flow 'volume_create_manager' (f666fa23-ee0c-4666-89c8-b11cca0ef762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324954fb-d167-4402-b083-d1a44f3a7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324954fb-d167-4402-b083-d1a44f3a7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1656809864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ccae00-41ea-4360-862f-36661af4d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc990c8082494fc1964e68ce7150a09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:42Z,use_quota=True,user_id='4be246e6a7a34082b65e5fe2b7f98558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9945d21a-7ed3-46f6-9c6b-5d957c04a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9945d21a-7ed3-46f6-9c6b-5d957c04a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887a640d-3b27-4008-a9e0-31f4a106ec95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887a640d-3b27-4008-a9e0-31f4a106ec95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ccae00-41ea-4360-862f-36661af4d495', 'volume_name': 'volume-a6ccae00-41ea-4360-862f-36661af4d495', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8468b76e-372f-4c57-9ba3-c55dc8e28130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8468b76e-372f-4c57-9ba3-c55dc8e28130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590a9d9d-2407-45dc-87f9-fc7bbb15cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Volume a6ccae00-41ea-4360-862f-36661af4d495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ccae00-41ea-4360-862f-36661af4d495', 'volume_size': 1} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:42 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 Jul 17 07:06:42 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Flow 'volume_create_manager' (fe92df82-3a65-4b36-b5a9-91f009bc46bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49b5208-35af-4e4e-8668-9c3726fc910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49b5208-35af-4e4e-8668-9c3726fc910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-480100108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f389ee44-eab5-489f-b2a2-e784644b829f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546f992cae3b4bc3bd7f754a153ddd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:43Z,use_quota=True,user_id='b86e2e32ddea4773af1f4b04583f11ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1f5f30-7c1f-4a03-a8a9-bee233a2c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1f5f30-7c1f-4a03-a8a9-bee233a2c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f027dd39-f28f-4e66-859c-5d21f56820c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f027dd39-f28f-4e66-859c-5d21f56820c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f389ee44-eab5-489f-b2a2-e784644b829f', 'volume_name': 'volume-f389ee44-eab5-489f-b2a2-e784644b829f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90545761-ea7f-4263-a62a-c0180cfa8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90545761-ea7f-4263-a62a-c0180cfa8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b8c861-d19d-4c2d-a1a3-09f2f056e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Volume f389ee44-eab5-489f-b2a2-e784644b829f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f389ee44-eab5-489f-b2a2-e784644b829f', 'volume_size': 1} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:42 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9" returned: 0 in 0.304s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1656809864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ccae00-41ea-4360-862f-36661af4d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc990c8082494fc1964e68ce7150a09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:42Z,use_quota=True,user_id='4be246e6a7a34082b65e5fe2b7f98558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Creating volume a6ccae00-41ea-4360-862f-36661af4d495 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:42 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4244ba-1523-4951-a717-b9bd7ec2bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708b1290-3a21-41a0-b275-467030aa20b9', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 1073741824 Jul 17 07:06:42 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85828b16-f778-4f6c-bea5-a5f1203bd89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Volume volume-708b1290-3a21-41a0-b275-467030aa20b9 (708b1290-3a21-41a0-b275-467030aa20b9): created successfully Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85828b16-f778-4f6c-bea5-a5f1203bd89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Flow 'volume_create_manager' (f1e95718-c5b2-48b1-a212-41ea8a4c5528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0767f0b9-e17b-4aea-a576-cd5470b1c998 tempest-AttachVolumeTestJSON-501762225 None] Created volume successfully. Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Flow 'volume_create_manager' (e56b9438-cebd-4f17-b6be-8cd8d5193142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d878309-1688-454c-8ec6-e9157ea7027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d878309-1688-454c-8ec6-e9157ea7027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-736885798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c81d17-e42d-4207-aec5-854e7cb9e4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd7ac6f670948929301a3d410b9fe9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:43Z,use_quota=True,user_id='76abd68070314df2861c8a3e53443d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e771c8eb-cdf6-47cd-8bbe-fac4cf0986e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e771c8eb-cdf6-47cd-8bbe-fac4cf0986e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660eef98-2128-44f2-ace1-b0faa39d54b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660eef98-2128-44f2-ace1-b0faa39d54b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c81d17-e42d-4207-aec5-854e7cb9e4b3', 'volume_name': 'volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9577605-191f-46f9-ad15-fd47ddf382aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9577605-191f-46f9-ad15-fd47ddf382aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b40091-c01d-4c17-9ae2-f08fbb366224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Volume b9c81d17-e42d-4207-aec5-854e7cb9e4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3', 'volume_size': 1} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:43 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 1073741824" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:43 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 Jul 17 07:06:43 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:43 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495" returned: 0 in 0.244s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-480100108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f389ee44-eab5-489f-b2a2-e784644b829f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546f992cae3b4bc3bd7f754a153ddd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:43Z,use_quota=True,user_id='b86e2e32ddea4773af1f4b04583f11ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Creating volume f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590a9d9d-2407-45dc-87f9-fc7bbb15cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ccae00-41ea-4360-862f-36661af4d495', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:43 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f 1073741824 Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8d76d9-60f0-452c-9140-728fcdbd7da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:43 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Volume volume-a6ccae00-41ea-4360-862f-36661af4d495 (a6ccae00-41ea-4360-862f-36661af4d495): created successfully Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8d76d9-60f0-452c-9140-728fcdbd7da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Flow 'volume_create_manager' (f666fa23-ee0c-4666-89c8-b11cca0ef762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a201da28-2b5f-44ea-984f-371609ee5fe2 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Created volume successfully. Jul 17 07:06:43 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f 1073741824" returned: 0 in 0.429s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:43 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f Jul 17 07:06:43 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:44 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f" returned: 0 in 0.268s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-736885798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c81d17-e42d-4207-aec5-854e7cb9e4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd7ac6f670948929301a3d410b9fe9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:43Z,use_quota=True,user_id='76abd68070314df2861c8a3e53443d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Creating volume b9c81d17-e42d-4207-aec5-854e7cb9e4b3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b8c861-d19d-4c2d-a1a3-09f2f056e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f389ee44-eab5-489f-b2a2-e784644b829f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:44 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 1073741824 Jul 17 07:06:44 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b16a57-3041-47d7-ac8b-20c958f5cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Volume volume-f389ee44-eab5-489f-b2a2-e784644b829f (f389ee44-eab5-489f-b2a2-e784644b829f): created successfully Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b16a57-3041-47d7-ac8b-20c958f5cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Flow 'volume_create_manager' (fe92df82-3a65-4b36-b5a9-91f009bc46bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-947467a0-2ae9-4242-9c00-a83e36b9dd69 req-2421204b-5352-46c5-800d-ea6af866aebc tempest-VolumesSnapshotsTestJSON-1787929280 None] Created volume successfully. Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-f709e0d5-2175-412e-8f9c-5c8774365bfe req-3f618186-e475-44b2-aebf-bd3663eed97d tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:44 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 1073741824" returned: 0 in 0.444s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:44 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 Jul 17 07:06:44 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:44 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3" returned: 0 in 0.256s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-f709e0d5-2175-412e-8f9c-5c8774365bfe req-3f618186-e475-44b2-aebf-bd3663eed97d tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.529s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b40091-c01d-4c17-9ae2-f08fbb366224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbfcc13-7650-48a7-a7a2-e0e231d6cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-f709e0d5-2175-412e-8f9c-5c8774365bfe req-3f618186-e475-44b2-aebf-bd3663eed97d tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Volume volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 (b9c81d17-e42d-4207-aec5-854e7cb9e4b3): created successfully Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbfcc13-7650-48a7-a7a2-e0e231d6cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Flow 'volume_create_manager' (e56b9438-cebd-4f17-b6be-8cd8d5193142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-f709e0d5-2175-412e-8f9c-5c8774365bfe req-3f618186-e475-44b2-aebf-bd3663eed97d tempest-AttachVolumeTestJSON-501762225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-708b1290-3a21-41a0-b275-467030aa20b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abb552d9-8da0-4c34-9475-008b4175571a', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:06:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e453dd22-f370-4c31-993e-ebf03d928046 tempest-AttachVolumeShelveTestJSON-630609502 None] Created volume successfully. Jul 17 07:06:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-f709e0d5-2175-412e-8f9c-5c8774365bfe req-3f618186-e475-44b2-aebf-bd3663eed97d tempest-AttachVolumeTestJSON-501762225 None] attachment_update completed successfully. Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Creating offline snapshot d602660d-e343-4050-8eb8-f6f8271d3328 of volume f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[390252f5-153c-4454-8027-27f39973f707]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:45 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f Jul 17 07:06:45 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Acquiring lock "cinder-a6ccae00-41ea-4360-862f-36661af4d495-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "cinder-a6ccae00-41ea-4360-862f-36661af4d495-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Acquiring lock "cinder-quobyte-a6ccae00-41ea-4360-862f-36661af4d495" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "cinder-quobyte-a6ccae00-41ea-4360-862f-36661af4d495" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660c0e8-05ef-403c-8830-59b2b366323b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:45 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f" returned: 0 in 0.490s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:45 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 1G Jul 17 07:06:45 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:45 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 Jul 17 07:06:45 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:46 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:46 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495 Jul 17 07:06:46 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:46 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 1G" returned: 0 in 0.457s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f389ee44-eab5-489f-b2a2-e784644b829f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:46 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f389ee44-eab5-489f-b2a2-e784644b829f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 Jul 17 07:06:46 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:46 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a6ccae00-41ea-4360-862f-36661af4d495" returned: 0 in 0.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "cinder-quobyte-a6ccae00-41ea-4360-862f-36661af4d495" released by "delete_volume" :: held 0.726s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Created reservations ['b4e77407-09ef-4484-b979-7b4c0e8eeebe', 'f7a8aa55-455c-4889-be31-aad659b1b458', 'aeb88e72-3cdf-4541-bb4d-41068658739a', '107bd590-940a-4ccc-bd88-939a8b9986e2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:46 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f389ee44-eab5-489f-b2a2-e784644b829f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328" returned: 0 in 0.379s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:46 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 is being set with open permissions: ugo+rw Jul 17 07:06:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:46 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:46 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:46 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 Jul 17 07:06:46 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:47 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328" returned: 0 in 0.333s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:47 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.395s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Deleted volume successfully. Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250b871a-778b-48f6-b6da-2b527e0075c1 tempest-VolumeQuotasNegativeTestJSON-1353345053 None] Lock "cinder-a6ccae00-41ea-4360-862f-36661af4d495-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:47 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info Jul 17 07:06:47 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:47 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info" returned: 0 in 0.394s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:47 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info is being set with open permissions: ugo+rw Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:47 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info Jul 17 07:06:47 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:47 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.info" returned: 0 in 0.396s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-9f7adc02-e583-48db-9d39-cd206170d747 req-69b7051f-37c9-453b-9629-a251b89936b0 tempest-AttachVolumeTestJSON-501762225 None] Terminate volume connection completed successfully. Jul 17 07:06:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-9f7adc02-e583-48db-9d39-cd206170d747 req-69b7051f-37c9-453b-9629-a251b89936b0 tempest-AttachVolumeTestJSON-501762225 None] Deleting attachment ad89e38d-89d3-4dd9-9be1-2741ffd8ee57. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:06:48 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-62551e94-7266-4a7b-ae59-470789264172 req-691ee6ce-14f5-4c27-a860-c48594fc2aa7 tempest-VolumesSnapshotsTestJSON-1787929280 None] Create snapshot completed successfully Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "cinder-d602660d-e343-4050-8eb8-f6f8271d3328-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-d602660d-e343-4050-8eb8-f6f8271d3328-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "cinder-quobyte-f389ee44-eab5-489f-b2a2-e784644b829f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-quobyte-f389ee44-eab5-489f-b2a2-e784644b829f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "cinder-quobyte-d602660d-e343-4050-8eb8-f6f8271d3328" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-quobyte-d602660d-e343-4050-8eb8-f6f8271d3328" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Deleting offline snapshot d602660d-e343-4050-8eb8-f6f8271d3328 of volume f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] snapshot_file for this snap is: volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26af42a-9c53-4540-bbba-d913b55ad441]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:49 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 Jul 17 07:06:49 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-e54a261c-8204-49e5-b4e2-9cd72a17c46a req-83fb9c58-8734-44ce-b84d-ce83c7eff532 tempest-AttachVolumeTestJSON-501762225 None] Terminate volume connection completed successfully. Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-e54a261c-8204-49e5-b4e2-9cd72a17c46a req-83fb9c58-8734-44ce-b84d-ce83c7eff532 tempest-AttachVolumeTestJSON-501762225 None] Deleting attachment abb552d9-8da0-4c34-9475-008b4175571a. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:06:49 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328" returned: 0 in 0.463s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f389ee44-eab5-489f-b2a2-e784644b829f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010fb63-8198-4e8b-82b3-526d86a89f21]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:49 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f Jul 17 07:06:49 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:50 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f" returned: 0 in 0.494s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:50 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 Jul 17 07:06:50 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:50 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328" returned: 0 in 0.525s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:50 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328 Jul 17 07:06:50 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:51 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f.d602660d-e343-4050-8eb8-f6f8271d3328" returned: 0 in 0.493s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-quobyte-d602660d-e343-4050-8eb8-f6f8271d3328" released by "_delete_snapshot" :: held 2.228s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-quobyte-f389ee44-eab5-489f-b2a2-e784644b829f" released by "delete_snapshot" :: held 2.273s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:51 devstack cinder-volume[87331]: WARNING cinder.quota [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:06:51 devstack cinder-volume[87331]: DEBUG cinder.quota [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Created reservations ['b3726317-507c-4990-8fe6-d5a4a2c27eec', 'a576a582-3eab-4e85-bd04-66024c83d62f', 'e839d2fd-4079-4734-a3c3-9e2a75572ee8', 'b11553d0-1195-47d2-aec6-d6e9c913235c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Delete snapshot completed successfully. Jul 17 07:06:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-03483f0c-d787-4bbf-8d11-a504651c082e req-074a5e52-b7f1-4c6e-b602-9940d22e7d05 tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-d602660d-e343-4050-8eb8-f6f8271d3328-delete_snapshot" released by "delete_snapshot" :: held 2.553s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "cinder-f389ee44-eab5-489f-b2a2-e784644b829f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-f389ee44-eab5-489f-b2a2-e784644b829f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "cinder-quobyte-f389ee44-eab5-489f-b2a2-e784644b829f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-quobyte-f389ee44-eab5-489f-b2a2-e784644b829f" acquired by "delete_volume" :: waited 0.041s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[caafa696-5bea-4a11-a344-c14d4c8de5ee]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:53 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f Jul 17 07:06:53 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:53 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f" returned: 0 in 0.490s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:53 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f Jul 17 07:06:53 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:53 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f389ee44-eab5-489f-b2a2-e784644b829f" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-quobyte-f389ee44-eab5-489f-b2a2-e784644b829f" released by "delete_volume" :: held 0.917s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG cinder.quota [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Created reservations ['4057d134-135f-40ea-a619-6d35bf50c7cb', '71938153-1265-437b-9f1d-dea7e6ddb788', '3b464137-e2bd-42c4-af2e-b03ca027de40', 'b33a5368-08c7-46b1-b5ba-c075741a1eaa'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:54 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:54 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:54 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG cinder.manager [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Deleted volume successfully. Jul 17 07:06:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-fe927179-6f8e-4d36-8d43-7f46761b9d63 req-26988d20-3080-469b-b318-9a8f21847c1f tempest-VolumesSnapshotsTestJSON-1787929280 None] Lock "cinder-f389ee44-eab5-489f-b2a2-e784644b829f-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Flow 'volume_create_manager' (a4c50a28-e77e-49d9-922f-943bdc7d0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d746723a-7bf3-4d0a-80c3-1a835b8951cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d746723a-7bf3-4d0a-80c3-1a835b8951cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1923556134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2c78ca-e651-4d29-b90d-d8921e3992e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a7cdcdeeee46b3a6a6d710b23f8a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:55Z,use_quota=True,user_id='4932921829044c75af78e5c570064337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1659bb-10cb-4949-8c1c-83f8b0c8d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1659bb-10cb-4949-8c1c-83f8b0c8d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c04c8a0-f2ef-43af-95fc-c795d868dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c04c8a0-f2ef-43af-95fc-c795d868dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2c78ca-e651-4d29-b90d-d8921e3992e6', 'volume_name': 'volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de6644f-742a-4a4d-a8ef-1ed83053e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de6644f-742a-4a4d-a8ef-1ed83053e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1390483-6348-4375-a270-1bd1cc33ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:55 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Volume 4c2c78ca-e651-4d29-b90d-d8921e3992e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6', 'volume_size': 1} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1923556134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2c78ca-e651-4d29-b90d-d8921e3992e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a7cdcdeeee46b3a6a6d710b23f8a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:06:55Z,use_quota=True,user_id='4932921829044c75af78e5c570064337',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Creating volume 4c2c78ca-e651-4d29-b90d-d8921e3992e6 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:55 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:55 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 1073741824 Jul 17 07:06:55 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:55 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 1073741824" returned: 0 in 0.494s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "cinder-708b1290-3a21-41a0-b275-467030aa20b9-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:55 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 Jul 17 07:06:55 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-708b1290-3a21-41a0-b275-467030aa20b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "cinder-quobyte-708b1290-3a21-41a0-b275-467030aa20b9" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-quobyte-708b1290-3a21-41a0-b275-467030aa20b9" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b644a005-2433-4b54-a166-68587cb219cd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:55 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 Jul 17 07:06:55 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:55 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6" returned: 0 in 0.296s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1390483-6348-4375-a270-1bd1cc33ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0e2692-2c7d-4d32-9074-6ed42e90f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:56 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Volume volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 (4c2c78ca-e651-4d29-b90d-d8921e3992e6): created successfully Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0e2692-2c7d-4d32-9074-6ed42e90f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Flow 'volume_create_manager' (a4c50a28-e77e-49d9-922f-943bdc7d0125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a62df622-4a4e-4d99-bf59-f44c090917e1 tempest-VolumesServicesTestJSON-1989022073 None] Created volume successfully. Jul 17 07:06:56 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9" returned: 0 in 0.470s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:56 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9 Jul 17 07:06:56 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:56 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-708b1290-3a21-41a0-b275-467030aa20b9" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-quobyte-708b1290-3a21-41a0-b275-467030aa20b9" released by "delete_volume" :: held 0.797s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Created reservations ['e96d79c9-c373-4b29-889b-63ec8e854948', 'acf764ea-cdf9-4e52-a6fa-9f8f095c08c7', '8663258b-b42d-40f8-9c65-4f5e4bbb135e', 'd4132bc0-55cc-4050-9b1e-226e797e91f7'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:56 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:56 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "cinder-76a80449-0c94-4345-bbca-b9b8b59169d3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-76a80449-0c94-4345-bbca-b9b8b59169d3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "cinder-quobyte-76a80449-0c94-4345-bbca-b9b8b59169d3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-quobyte-76a80449-0c94-4345-bbca-b9b8b59169d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e27c8-f730-4606-bba9-e8e8bd559a2c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:57 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.354s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Deleted volume successfully. Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-72c37186-3a3e-4605-9b4f-de0c995bf738 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-708b1290-3a21-41a0-b275-467030aa20b9-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:57 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 Jul 17 07:06:57 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-08cd3133-6c25-4f06-98aa-52f2b33e67f1 req-23c4c20b-2ba5-4113-8200-b002d47b04ba tempest-AttachVolumeShelveTestJSON-630609502 None] No connector for attachment 0eca8663-0446-4fad-8628-7b2df87f7af6; skipping storage backend terminate_connection call. {{(pid=87331) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-08cd3133-6c25-4f06-98aa-52f2b33e67f1 req-23c4c20b-2ba5-4113-8200-b002d47b04ba tempest-AttachVolumeShelveTestJSON-630609502 None] Deleting attachment 0eca8663-0446-4fad-8628-7b2df87f7af6. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Acquiring lock "cinder-4c2c78ca-e651-4d29-b90d-d8921e3992e6-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:57 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3" returned: 0 in 0.478s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Lock "cinder-4c2c78ca-e651-4d29-b90d-d8921e3992e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:57 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3 Jul 17 07:06:57 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Acquiring lock "cinder-quobyte-4c2c78ca-e651-4d29-b90d-d8921e3992e6" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Lock "cinder-quobyte-4c2c78ca-e651-4d29-b90d-d8921e3992e6" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c0ffa-6a60-4fdb-a9f7-3a3e202cc3b8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:57 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 Jul 17 07:06:57 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:57 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-76a80449-0c94-4345-bbca-b9b8b59169d3" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-quobyte-76a80449-0c94-4345-bbca-b9b8b59169d3" released by "delete_volume" :: held 0.838s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Created reservations ['2c7522a8-7afb-4606-8af3-0392ad838d8c', '70a66646-2cdc-4079-9f84-73d56ef7914d', '679fbdc0-700f-44bd-b00f-b27b59c21255', '81375bcb-98b4-4bcc-b418-b8cd880652bf'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:58 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:58 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:58 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6" returned: 0 in 0.468s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:58 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6 Jul 17 07:06:58 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "cinder-bf69d19e-8011-4016-b7a3-7299d5dd300e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-bf69d19e-8011-4016-b7a3-7299d5dd300e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "cinder-quobyte-bf69d19e-8011-4016-b7a3-7299d5dd300e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-quobyte-bf69d19e-8011-4016-b7a3-7299d5dd300e" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:06:58 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.414s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:58 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Deleted volume successfully. Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1236d-be57-4965-bcbd-59878feddb50]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3a21eca1-bc7e-43c2-84f4-06547aef05d9 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-76a80449-0c94-4345-bbca-b9b8b59169d3-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:58 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e Jul 17 07:06:58 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:58 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4c2c78ca-e651-4d29-b90d-d8921e3992e6" returned: 0 in 0.487s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Lock "cinder-quobyte-4c2c78ca-e651-4d29-b90d-d8921e3992e6" released by "delete_volume" :: held 1.016s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Created reservations ['95daccee-8a18-482c-a4cb-9a77e1600ce6', '642634aa-e543-4e94-aa43-c85a09435aea', 'ea9967f3-d268-4cf5-b792-17c3fe99f953', '8424e159-db23-4ca0-8a3e-3d232fe336f9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:58 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:58 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:58 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e" returned: 0 in 0.521s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:58 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e Jul 17 07:06:58 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:59 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.328s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Deleted volume successfully. Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-13a563d4-0cac-468b-a32b-07643189690d tempest-VolumesServicesTestJSON-1989022073 None] Lock "cinder-4c2c78ca-e651-4d29-b90d-d8921e3992e6-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:59 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bf69d19e-8011-4016-b7a3-7299d5dd300e" returned: 0 in 0.313s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-quobyte-bf69d19e-8011-4016-b7a3-7299d5dd300e" released by "delete_volume" :: held 0.903s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Created reservations ['ba011e44-3cd0-49f2-a9ac-571cd32242d0', 'd9733cdf-6ab0-41f1-b865-f7fce5fae43e', 'a54e2bcc-9edf-486d-b4a0-0e106f4f088b', 'dd65dd3b-3ac6-4416-adcb-286e2302ab85'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:59 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:06:59 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Flow 'volume_create_manager' (77fc3874-14b3-4f52-bd18-581a6ec14e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed62abff-bf11-461c-ac30-c1b943393ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed62abff-bf11-461c-ac30-c1b943393ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1131652608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e25b3c-ef1e-4bf2-8793-d45efd202bd7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4a6d60360b44e52944bb1723d7b2466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:00Z,use_quota=True,user_id='460caf485e814924adef836df1e14762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7009f2a9-0756-45c4-a0fa-3c5e7f767721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7009f2a9-0756-45c4-a0fa-3c5e7f767721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdcbfe7-538a-48ac-868f-6d1897bd3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdcbfe7-538a-48ac-868f-6d1897bd3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e25b3c-ef1e-4bf2-8793-d45efd202bd7', 'volume_name': 'volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28162af-be37-4bd1-9d73-8090840fe1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28162af-be37-4bd1-9d73-8090840fe1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd4234b-cf42-41d1-b137-5d557aca202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:06:59 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Volume a1e25b3c-ef1e-4bf2-8793-d45efd202bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7', 'volume_size': 1} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1131652608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e25b3c-ef1e-4bf2-8793-d45efd202bd7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4a6d60360b44e52944bb1723d7b2466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:00Z,use_quota=True,user_id='460caf485e814924adef836df1e14762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Creating volume a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:06:59 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:06:59 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 1073741824 Jul 17 07:06:59 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:06:59 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:06:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Deleted volume successfully. Jul 17 07:06:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-344f22b2-ca0b-4908-8737-d2f13d0333c0 tempest-AttachVolumeTestJSON-501762225 None] Lock "cinder-bf69d19e-8011-4016-b7a3-7299d5dd300e-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:00 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 1073741824" returned: 0 in 0.645s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=158,cinder:SELECT=134,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=147,cinder:SELECT=118,cinder:INSERT=34,cinder:DELETE=13 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:00 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 Jul 17 07:07:00 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:00 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7" returned: 0 in 0.328s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd4234b-cf42-41d1-b137-5d557aca202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f67a5e7-0f93-4d03-8c45-8acc35d288ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:00 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Volume volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 (a1e25b3c-ef1e-4bf2-8793-d45efd202bd7): created successfully Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f67a5e7-0f93-4d03-8c45-8acc35d288ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Flow 'volume_create_manager' (77fc3874-14b3-4f52-bd18-581a6ec14e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:00 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-38454192-1792-43e3-99f0-260a442b8569 req-37a2c4b3-6104-4712-8b48-1ba24b7c9933 tempest-VolumesGetTestJSON-823520047 None] Created volume successfully. Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Acquiring lock "cinder-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Lock "cinder-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Acquiring lock "cinder-quobyte-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Lock "cinder-quobyte-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c742c0f1-88f4-4d3e-8daf-75b0e8d7f8c0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:02 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 Jul 17 07:07:02 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:02 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:02 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7 Jul 17 07:07:02 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:03 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7" returned: 0 in 0.304s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Lock "cinder-quobyte-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7" released by "delete_volume" :: held 0.773s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG cinder.quota [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Created reservations ['29e06903-f0cf-41e7-be15-7a9e6449e585', 'b3b40bac-c4ea-4b36-b55d-97a493028590', '5805910c-8ee2-4fe4-a87b-35ebeb7a8b3e', '78d7108f-1473-47ad-bedc-b318166355b8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:03 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:03 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:03 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.382s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG cinder.manager [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:03 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Deleted volume successfully. Jul 17 07:07:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-6084142c-6fa5-447c-a0d3-608052efca22 req-f08694a6-b0d9-49ce-a6ff-f47892d4c62b tempest-VolumesGetTestJSON-823520047 None] Lock "cinder-a1e25b3c-ef1e-4bf2-8793-d45efd202bd7-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70ac4e8f-e47e-4a76-8bbc-4aacaeb22816 tempest-GroupSnapshotsTest-383038828 None] Group tempest-GroupSnapshotsTest-Group-714890525: creating Jul 17 07:07:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70ac4e8f-e47e-4a76-8bbc-4aacaeb22816 tempest-GroupSnapshotsTest-383038828 None] Group tempest-GroupSnapshotsTest-Group-714890525: created successfully Jul 17 07:07:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70ac4e8f-e47e-4a76-8bbc-4aacaeb22816 tempest-GroupSnapshotsTest-383038828 None] Create group completed successfully. Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (35fde94b-91d0-4386-8710-3e9ffa5be917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106315e3-0391-465e-8706-5e8db4b57232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106315e3-0391-465e-8706-5e8db4b57232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-376074396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3c93ae5-bf68-4699-9895-050d1a7de84a,host='devstack@QuobyteHD#QuobyteHD',id=98a62850-6658-4716-a0d7-d5dca8913bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:13Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1059ad3e-2227-485c-a98e-e3666c21d94a),volume_type_id=1059ad3e-2227-485c-a98e-e3666c21d94a)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb279a94-157e-44a3-9216-ae243ff874f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb279a94-157e-44a3-9216-ae243ff874f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b05fec-78dc-4eda-884a-6e9921af2746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b05fec-78dc-4eda-884a-6e9921af2746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a62850-6658-4716-a0d7-d5dca8913bda', 'volume_name': 'volume-98a62850-6658-4716-a0d7-d5dca8913bda', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2924a652-a836-47ff-a113-533cd144cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2924a652-a836-47ff-a113-533cd144cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335cc8fa-ac2d-4202-b459-3740efc70829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:13 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Volume 98a62850-6658-4716-a0d7-d5dca8913bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a62850-6658-4716-a0d7-d5dca8913bda', 'volume_size': 1} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3c93ae5-bf68-4699-9895-050d1a7de84a,created_at=2026-07-17T05:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-376074396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3c93ae5-bf68-4699-9895-050d1a7de84a,host='devstack@QuobyteHD#QuobyteHD',id=98a62850-6658-4716-a0d7-d5dca8913bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:13Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1059ad3e-2227-485c-a98e-e3666c21d94a),volume_type_id=1059ad3e-2227-485c-a98e-e3666c21d94a)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Creating volume 98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:13 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:13 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda 1073741824 Jul 17 07:07:13 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:14 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda 1073741824" returned: 0 in 0.632s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:14 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:14 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:14 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.370s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335cc8fa-ac2d-4202-b459-3740efc70829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a62850-6658-4716-a0d7-d5dca8913bda', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0adec7e-edb6-4ef2-9f04-3586326ae256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:14 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Volume volume-98a62850-6658-4716-a0d7-d5dca8913bda (98a62850-6658-4716-a0d7-d5dca8913bda): created successfully Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0adec7e-edb6-4ef2-9f04-3586326ae256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (35fde94b-91d0-4386-8710-3e9ffa5be917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f972d938-0f5b-41a8-8598-63aca26c35b4 tempest-GroupSnapshotsTest-383038828 None] Created volume successfully. Jul 17 07:07:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] GroupSnapshot 95f09f5a-49ce-46cd-85d1-ec36c7201953: creating. Jul 17 07:07:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Group snapshot 95f09f5a-49ce-46cd-85d1-ec36c7201953: creating. {{(pid=87331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 07:07:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Creating offline snapshot 51e41758-5e5e-4954-bd87-133c7002b09b of volume 98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:07:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f13b1-9de0-4720-9451-e16f28860dbe]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:16 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:16 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:17 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:17 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b 1G Jul 17 07:07:17 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:17 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Flow 'volume_create_manager' (29d81dff-4252-4ca0-b6b2-4e20e57bf44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3a0822-2e2f-4323-90ec-8b1951e38655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b 1G" returned: 0 in 0.636s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a62850-6658-4716-a0d7-d5dca8913bda -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3a0822-2e2f-4323-90ec-8b1951e38655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-821892334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cda2c1-51a2-42fc-aa4b-ff55e4fef51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c2b4d6a6fb4038862cc46ae81e7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:18Z,use_quota=True,user_id='ad0266b9fc614b2980aa7b1c6647a290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b090e7c1-619e-4e9d-9cb2-ba2156f9f524),volume_type_id=b090e7c1-619e-4e9d-9cb2-ba2156f9f524)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e59e1d-2154-4825-a550-32d99e3c1bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:17 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a62850-6658-4716-a0d7-d5dca8913bda -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e59e1d-2154-4825-a550-32d99e3c1bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:17 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce57e78-9929-4d06-82cc-be427550f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce57e78-9929-4d06-82cc-be427550f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cda2c1-51a2-42fc-aa4b-ff55e4fef51e', 'volume_name': 'volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3853647-e4b8-44bf-9c28-a1add37ca9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3853647-e4b8-44bf-9c28-a1add37ca9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c371ea43-277a-4e1c-b025-06bb11cde5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Volume 17cda2c1-51a2-42fc-aa4b-ff55e4fef51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e', 'volume_size': 1} Jul 17 07:07:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:18 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a62850-6658-4716-a0d7-d5dca8913bda -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b" returned: 0 in 0.322s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:18 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:18 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b Jul 17 07:07:18 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:18 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b" returned: 0 in 0.277s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:18 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info Jul 17 07:07:18 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:18 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:18 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:18 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info Jul 17 07:07:18 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:18 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.info" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-821892334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cda2c1-51a2-42fc-aa4b-ff55e4fef51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c2b4d6a6fb4038862cc46ae81e7028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:18Z,use_quota=True,user_id='ad0266b9fc614b2980aa7b1c6647a290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b090e7c1-619e-4e9d-9cb2-ba2156f9f524),volume_type_id=b090e7c1-619e-4e9d-9cb2-ba2156f9f524)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Creating volume 17cda2c1-51a2-42fc-aa4b-ff55e4fef51e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:18 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:19 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e 1073741824 Jul 17 07:07:19 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4d9bdee0-f45d-44b7-8ed3-a9bedbd63bb6 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 95f09f5a-49ce-46cd-85d1-ec36c7201953: created successfully Jul 17 07:07:19 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e 1073741824" returned: 0 in 0.600s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:19 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e Jul 17 07:07:19 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:19 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e" returned: 0 in 0.348s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c371ea43-277a-4e1c-b025-06bb11cde5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b077b084-34a6-46f1-afac-d8bae14854dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Volume volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e (17cda2c1-51a2-42fc-aa4b-ff55e4fef51e): created successfully Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b077b084-34a6-46f1-afac-d8bae14854dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Flow 'volume_create_manager' (29d81dff-4252-4ca0-b6b2-4e20e57bf44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f560fd0d-c6e1-4efc-85c1-545ad9ed985f tempest-VolumeTypesAccessTest-1728264007 None] Created volume successfully. Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-51e41758-5e5e-4954-bd87-133c7002b09b-87b37489-1941-41e5-9957-75797fc2d6ed" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-51e41758-5e5e-4954-bd87-133c7002b09b-87b37489-1941-41e5-9957-75797fc2d6ed" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Creating volume 87b37489-1941-41e5-9957-75797fc2d6ed from snapshot 51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-87b37489-1941-41e5-9957-75797fc2d6ed" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-87b37489-1941-41e5-9957-75797fc2d6ed" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] snapshot: 51e41758-5e5e-4954-bd87-133c7002b09b, volume: 87b37489-1941-41e5-9957-75797fc2d6ed, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70927b7-9f93-422b-9b92-71963f0f50f3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:20 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b Jul 17 07:07:20 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Acquiring lock "cinder-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Lock "cinder-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Acquiring lock "cinder-quobyte-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Lock "cinder-quobyte-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc1072f-4aa6-46a1-af47-f5a500f0d3cc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:21 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b" returned: 0 in 0.599s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a62850-6658-4716-a0d7-d5dca8913bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f113ae-500b-49dd-b2cd-fdd9f6daefc7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:21 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e Jul 17 07:07:21 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:21 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:21 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:21 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e" returned: 0 in 0.428s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:21 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e Jul 17 07:07:21 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:21 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:07:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:21 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed Jul 17 07:07:21 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:22 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e" returned: 0 in 0.347s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Lock "cinder-quobyte-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e" released by "delete_volume" :: held 0.827s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:22 devstack cinder-volume[87331]: WARNING cinder.quota [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1798139440 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1798139440, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:07:22 devstack cinder-volume[87331]: WARNING cinder.quota [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1798139440 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1798139440, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Created reservations ['b42d627f-f584-4257-9120-8d7103addc6c', 'c0a81eef-879c-4f42-b9cd-b72685d2ea3e', '2536a2f5-ae56-46ad-b23c-5411eb3f4956', '3abb5b77-6cae-4470-9eef-1f873577bb30'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:22 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:22 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:22 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.437s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Deleted volume successfully. Jul 17 07:07:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2559eb3d-2e7f-4fc1-a80c-72485d964564 tempest-VolumeTypesAccessTest-1728264007 None] Lock "cinder-17cda2c1-51a2-42fc-aa4b-ff55e4fef51e-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:28 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed" returned: 0 in 6.518s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[26095a65-1df0-4962-b21e-b0b19734d2da]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:28 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:28 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:28 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.530s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:28 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:07:28 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Converted 1024.00 MB image at 157.07 MB/s Jul 17 07:07:28 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:28 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed Jul 17 07:07:28 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:29 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed" returned: 0 in 0.249s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-87b37489-1941-41e5-9957-75797fc2d6ed" released by "_copy_volume_from_snapshot" :: held 8.468s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-51e41758-5e5e-4954-bd87-133c7002b09b-87b37489-1941-41e5-9957-75797fc2d6ed" released by "_create_volume_from_snapshot" :: held 8.511s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.541s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6ae4716c-29eb-4fd0-ad1f-c2658b838f29 tempest-GroupSnapshotsTest-383038828 None] Create group from source-snapshot-95f09f5a-49ce-46cd-85d1-ec36c7201953 completed successfully. Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:29 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:29 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:30 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.251s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 8 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-87b37489-1941-41e5-9957-75797fc2d6ed" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-87b37489-1941-41e5-9957-75797fc2d6ed" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba082153-c487-4c3a-989f-c2e1e1860378]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:30 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed Jul 17 07:07:30 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:30 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed" returned: 0 in 0.436s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:30 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed Jul 17 07:07:30 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:30 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-87b37489-1941-41e5-9957-75797fc2d6ed" returned: 0 in 0.248s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-87b37489-1941-41e5-9957-75797fc2d6ed" released by "delete_volume" :: held 0.741s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['50ccd29c-bdc9-48c9-b0ae-860cba0ca55f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:31 devstack cinder-volume[87331]: WARNING cinder.quota [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1148052805 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1148052805, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:07:31 devstack cinder-volume[87331]: WARNING cinder.quota [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1148052805 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1148052805, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['7775224a-63d8-4228-ad64-326cb12d54ba', '5ba1b3bf-98d2-43d5-840d-801cbc6d5c8a', '03d8817d-025a-46e7-b97c-d9748095203a', 'abec2c3e-4c05-4a3d-875b-ef55e6ecf9eb'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:32 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:32 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:32 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:32 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d7dbab4e-df85-4320-9a74-e0e4e69a2109 tempest-GroupSnapshotsTest-383038828 None] Delete group completed successfully. Jul 17 07:07:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 95f09f5a-49ce-46cd-85d1-ec36c7201953: deleting Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 95f09f5a-49ce-46cd-85d1-ec36c7201953: deleting {{(pid=87331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-98a62850-6658-4716-a0d7-d5dca8913bda" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-98a62850-6658-4716-a0d7-d5dca8913bda" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-51e41758-5e5e-4954-bd87-133c7002b09b" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-51e41758-5e5e-4954-bd87-133c7002b09b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Deleting offline snapshot 51e41758-5e5e-4954-bd87-133c7002b09b of volume 98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] snapshot_file for this snap is: volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2d7b9f-1cce-414a-bc13-b0c37819882c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:33 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b Jul 17 07:07:33 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:33 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b" returned: 0 in 0.427s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a62850-6658-4716-a0d7-d5dca8913bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4542f4e-879d-41fc-be65-d747f4c2807b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:34 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:34 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:34 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:34 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b Jul 17 07:07:34 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:34 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b" returned: 0 in 0.514s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:34 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b Jul 17 07:07:34 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:35 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda.51e41758-5e5e-4954-bd87-133c7002b09b" returned: 0 in 0.354s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-51e41758-5e5e-4954-bd87-133c7002b09b" released by "_delete_snapshot" :: held 1.845s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-98a62850-6658-4716-a0d7-d5dca8913bda" released by "delete_snapshot" :: held 1.871s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:35 devstack cinder-volume[87331]: WARNING cinder.quota [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1148052805 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1148052805, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:07:35 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['4becceea-e995-4fef-b73f-a2f35dee162d', 'a755b6c3-10c9-4f7e-9a98-8071d3f81698', '89efe2ec-ee26-4285-be7f-1829b2a6b34d', 'f7f89fc3-c289-4112-8e71-05759c437e7a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c74b2ba6-8fe5-49fe-b31f-b25bb5b9ff42 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 95f09f5a-49ce-46cd-85d1-ec36c7201953: deleted successfully Jul 17 07:07:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-98a62850-6658-4716-a0d7-d5dca8913bda" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-98a62850-6658-4716-a0d7-d5dca8913bda" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:36 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a393b5f-3646-4cfb-816a-c3c7c139057c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:36 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:36 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:37 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.501s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:37 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda Jul 17 07:07:37 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:37 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-98a62850-6658-4716-a0d7-d5dca8913bda" returned: 0 in 0.408s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-98a62850-6658-4716-a0d7-d5dca8913bda" released by "delete_volume" :: held 1.018s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['743bce73-d45a-46bd-91fd-9c82842577f9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:37 devstack cinder-volume[87331]: WARNING cinder.db.api [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1148052805'] Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['f83ca575-1e5a-49e4-8f79-402faff92e11', '4937f923-e7ed-417b-8fab-676c1fa2aef9', '1a0fde6a-3c63-43c7-8e80-daaeb8efaac3', '104f8fae-7e06-4540-96c6-214ff86dcf7d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:37 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:37 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:38 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.406s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-23cfd41d-4aa9-4481-a2be-f01f41702258 tempest-GroupSnapshotsTest-383038828 None] Delete group completed successfully. Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Flow 'volume_create_manager' (cb3e8c9e-0235-4e84-a481-f047b833a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e99f962-cb88-4cfe-b13b-32b7556fcdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e99f962-cb88-4cfe-b13b-32b7556fcdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-358863401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ad8db3-f2fb-4e9c-b034-59ccbe80e012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb379ac475945cea2f5ddfe4d3e858d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:39Z,use_quota=True,user_id='114782d4cce6482792ee35181a010acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b16708-95cf-4acb-81bf-2614dccea90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b16708-95cf-4acb-81bf-2614dccea90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89447be-069f-4665-84ef-48da3569a574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89447be-069f-4665-84ef-48da3569a574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ad8db3-f2fb-4e9c-b034-59ccbe80e012', 'volume_name': 'volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01288929-cd2d-41d7-826e-8be711adc07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01288929-cd2d-41d7-826e-8be711adc07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5bef9d-09df-4963-b6af-7d1c878aca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:38 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Volume a3ad8db3-f2fb-4e9c-b034-59ccbe80e012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012', 'volume_size': 1} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-358863401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ad8db3-f2fb-4e9c-b034-59ccbe80e012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb379ac475945cea2f5ddfe4d3e858d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:39Z,use_quota=True,user_id='114782d4cce6482792ee35181a010acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Creating volume a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:38 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:38 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 1073741824 Jul 17 07:07:38 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:39 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 1073741824" returned: 0 in 0.529s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dca843b3-09ec-4f33-9768-bf7465819bd9 tempest-GroupSnapshotsTest-383038828 None] Group tempest-GroupSnapshotsTest-Group-305301713: creating Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:39 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 Jul 17 07:07:39 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dca843b3-09ec-4f33-9768-bf7465819bd9 tempest-GroupSnapshotsTest-383038828 None] Group tempest-GroupSnapshotsTest-Group-305301713: created successfully Jul 17 07:07:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dca843b3-09ec-4f33-9768-bf7465819bd9 tempest-GroupSnapshotsTest-383038828 None] Create group completed successfully. Jul 17 07:07:39 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5bef9d-09df-4963-b6af-7d1c878aca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a675667a-b286-483c-9f9c-e093c02d26c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Volume volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 (a3ad8db3-f2fb-4e9c-b034-59ccbe80e012): created successfully Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a675667a-b286-483c-9f9c-e093c02d26c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Flow 'volume_create_manager' (cb3e8c9e-0235-4e84-a481-f047b833a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c57c8a00-b3b2-40dd-b42b-3a0d3091abe3 tempest-VolumesListAdminTestJSON-873778526 None] Created volume successfully. Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Acquiring lock "cinder-b9c81d17-e42d-4207-aec5-854e7cb9e4b3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "cinder-b9c81d17-e42d-4207-aec5-854e7cb9e4b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Acquiring lock "cinder-quobyte-b9c81d17-e42d-4207-aec5-854e7cb9e4b3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "cinder-quobyte-b9c81d17-e42d-4207-aec5-854e7cb9e4b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7133f860-f880-4a86-854a-76d082e016df]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:40 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 Jul 17 07:07:40 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:40 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3" returned: 0 in 0.557s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:41 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3 Jul 17 07:07:41 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (f6484ab1-3093-4822-94d5-4911389ddbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791b5740-207c-4b56-b90e-a25a61ee7ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791b5740-207c-4b56-b90e-a25a61ee7ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378304786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ad1e71d-8f0d-4d04-8c76-a3a192c96183,host='devstack@QuobyteHD#QuobyteHD',id=41803e9a-9f54-4dd1-8dda-6c59c13ae7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:41Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57de47c9-3929-477c-b2d9-a12a689ecca3),volume_type_id=57de47c9-3929-477c-b2d9-a12a689ecca3)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16afce0a-ae6d-478c-be96-3fa199fbc801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16afce0a-ae6d-478c-be96-3fa199fbc801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9eba850-5f0a-4e46-a78c-5e41fd06a7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9eba850-5f0a-4e46-a78c-5e41fd06a7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41803e9a-9f54-4dd1-8dda-6c59c13ae7e2', 'volume_name': 'volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8747965-2904-4ec9-b469-18ad05db19ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8747965-2904-4ec9-b469-18ad05db19ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6145333c-036f-449e-bd10-f9e7017735e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Volume 41803e9a-9f54-4dd1-8dda-6c59c13ae7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2', 'volume_size': 1} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ad1e71d-8f0d-4d04-8c76-a3a192c96183,created_at=2026-07-17T05:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378304786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ad1e71d-8f0d-4d04-8c76-a3a192c96183,host='devstack@QuobyteHD#QuobyteHD',id=41803e9a-9f54-4dd1-8dda-6c59c13ae7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:41Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57de47c9-3929-477c-b2d9-a12a689ecca3),volume_type_id=57de47c9-3929-477c-b2d9-a12a689ecca3)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Creating volume 41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:41 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:41 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 1073741824 Jul 17 07:07:41 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:41 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b9c81d17-e42d-4207-aec5-854e7cb9e4b3" returned: 0 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "cinder-quobyte-b9c81d17-e42d-4207-aec5-854e7cb9e4b3" released by "delete_volume" :: held 0.986s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Created reservations ['829e8bb1-e932-41f5-8236-074b1f21a1fe', 'f5aaff96-9a53-412e-8169-4f4b5a6a3479', 'b6e846f9-3646-4b49-9dc8-265e856b9089', 'e77dc7e3-65d9-484d-a4f1-1a441e7863bb'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:41 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:41 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Flow 'volume_create_manager' (0ca6f1f9-88ac-4230-a2d7-885b432b1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65a259d-8afc-48c3-8654-be6b31a8020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65a259d-8afc-48c3-8654-be6b31a8020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1852005923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19feeff1-5a3a-41a6-8e35-eca7265fe1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb379ac475945cea2f5ddfe4d3e858d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:42Z,use_quota=True,user_id='114782d4cce6482792ee35181a010acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b68a43-a0ef-45d4-9bc5-01e5c4f87bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b68a43-a0ef-45d4-9bc5-01e5c4f87bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4721c39-0776-46a0-b29c-623a50f4f959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4721c39-0776-46a0-b29c-623a50f4f959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19feeff1-5a3a-41a6-8e35-eca7265fe1a2', 'volume_name': 'volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04447c95-4ab4-4473-9f33-04d6b5f4a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04447c95-4ab4-4473-9f33-04d6b5f4a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c57c51-710a-4ab7-81b7-94494bfa85b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Volume 19feeff1-5a3a-41a6-8e35-eca7265fe1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2', 'volume_size': 1} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:41 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 1073741824" returned: 0 in 0.578s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:41 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.285s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Deleted volume successfully. Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7a6a9341-1b0d-4dd1-9fee-e355c57586de tempest-AttachVolumeShelveTestJSON-630609502 None] Lock "cinder-b9c81d17-e42d-4207-aec5-854e7cb9e4b3-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:41 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 Jul 17 07:07:41 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:42 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" returned: 0 in 0.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1852005923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19feeff1-5a3a-41a6-8e35-eca7265fe1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb379ac475945cea2f5ddfe4d3e858d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:42Z,use_quota=True,user_id='114782d4cce6482792ee35181a010acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Creating volume 19feeff1-5a3a-41a6-8e35-eca7265fe1a2 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:42 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6145333c-036f-449e-bd10-f9e7017735e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:42 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 1073741824 Jul 17 07:07:42 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa93c328-1d8e-474e-9996-cac834842f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Volume volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 (41803e9a-9f54-4dd1-8dda-6c59c13ae7e2): created successfully Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa93c328-1d8e-474e-9996-cac834842f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (f6484ab1-3093-4822-94d5-4911389ddbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4fca8d51-bb8f-46b5-9a80-1819df3b6b87 tempest-GroupSnapshotsTest-383038828 None] Created volume successfully. Jul 17 07:07:42 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 1073741824" returned: 0 in 0.513s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:42 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 Jul 17 07:07:42 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:43 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2" returned: 0 in 0.329s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c57c51-710a-4ab7-81b7-94494bfa85b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203a5d5b-b245-4747-9cde-16a10452c6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Volume volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 (19feeff1-5a3a-41a6-8e35-eca7265fe1a2): created successfully Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203a5d5b-b245-4747-9cde-16a10452c6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Flow 'volume_create_manager' (0ca6f1f9-88ac-4230-a2d7-885b432b1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-54ee35e3-fcfe-41e3-80a3-72c3fae86d69 tempest-VolumesListAdminTestJSON-873778526 None] Created volume successfully. Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (90ebe600-d078-4f4e-85d2-74ad886f0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01381682-70ab-4041-9486-702c0fbff42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01381682-70ab-4041-9486-702c0fbff42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286349242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ad1e71d-8f0d-4d04-8c76-a3a192c96183,host='devstack@QuobyteHD#QuobyteHD',id=826567bc-9863-4496-8302-fdaee59f4a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:43Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57de47c9-3929-477c-b2d9-a12a689ecca3),volume_type_id=57de47c9-3929-477c-b2d9-a12a689ecca3)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cab5b8-2d56-4567-9603-db964fb3817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cab5b8-2d56-4567-9603-db964fb3817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c64a5e6-cb61-43e4-8370-9afcad3c73fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c64a5e6-cb61-43e4-8370-9afcad3c73fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826567bc-9863-4496-8302-fdaee59f4a1e', 'volume_name': 'volume-826567bc-9863-4496-8302-fdaee59f4a1e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0849a2-ccc4-46c5-b104-37d4d170b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0849a2-ccc4-46c5-b104-37d4d170b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393b8c58-581c-4b4e-b549-c1b6874eb355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Volume 826567bc-9863-4496-8302-fdaee59f4a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826567bc-9863-4496-8302-fdaee59f4a1e', 'volume_size': 1} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ad1e71d-8f0d-4d04-8c76-a3a192c96183,created_at=2026-07-17T05:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286349242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ad1e71d-8f0d-4d04-8c76-a3a192c96183,host='devstack@QuobyteHD#QuobyteHD',id=826567bc-9863-4496-8302-fdaee59f4a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:43Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57de47c9-3929-477c-b2d9-a12a689ecca3),volume_type_id=57de47c9-3929-477c-b2d9-a12a689ecca3)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Creating volume 826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:43 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e 1073741824 Jul 17 07:07:43 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:43 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e 1073741824" returned: 0 in 0.553s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:44 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e Jul 17 07:07:44 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:44 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e" returned: 0 in 0.399s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393b8c58-581c-4b4e-b549-c1b6874eb355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826567bc-9863-4496-8302-fdaee59f4a1e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81046821-26a8-44aa-bc0c-6bd6c2817db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Volume volume-826567bc-9863-4496-8302-fdaee59f4a1e (826567bc-9863-4496-8302-fdaee59f4a1e): created successfully Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81046821-26a8-44aa-bc0c-6bd6c2817db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (90ebe600-d078-4f4e-85d2-74ad886f0613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f04fb26d-e121-41f0-8930-9eeb4986db58 tempest-GroupSnapshotsTest-383038828 None] Created volume successfully. Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Flow 'volume_create_manager' (0536085b-8cd8-4999-bc96-c3eb45f75c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4c6e87-f4f8-4101-9add-471ce1a065c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4c6e87-f4f8-4101-9add-471ce1a065c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-690924420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175515f1-40e6-4b02-a228-f369cc6f601a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb379ac475945cea2f5ddfe4d3e858d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:44Z,use_quota=True,user_id='114782d4cce6482792ee35181a010acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4803630-af9c-4d68-809a-d1c3d78351a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4803630-af9c-4d68-809a-d1c3d78351a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d4b919-32b6-4f5d-90b9-290b1e949434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d4b919-32b6-4f5d-90b9-290b1e949434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175515f1-40e6-4b02-a228-f369cc6f601a', 'volume_name': 'volume-175515f1-40e6-4b02-a228-f369cc6f601a', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819a7128-3832-4177-b5f5-9810066e2841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819a7128-3832-4177-b5f5-9810066e2841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0f024a-ab68-4b86-88be-1f21f99dcd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Volume 175515f1-40e6-4b02-a228-f369cc6f601a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175515f1-40e6-4b02-a228-f369cc6f601a', 'volume_size': 1} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-690924420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175515f1-40e6-4b02-a228-f369cc6f601a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb379ac475945cea2f5ddfe4d3e858d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:44Z,use_quota=True,user_id='114782d4cce6482792ee35181a010acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Creating volume 175515f1-40e6-4b02-a228-f369cc6f601a {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:44 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a 1073741824 Jul 17 07:07:44 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:45 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a 1073741824" returned: 0 in 0.519s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:45 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a Jul 17 07:07:45 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:45 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a" returned: 0 in 0.260s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0f024a-ab68-4b86-88be-1f21f99dcd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175515f1-40e6-4b02-a228-f369cc6f601a', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd80e7-aa0a-468d-9224-adec3e4598e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Volume volume-175515f1-40e6-4b02-a228-f369cc6f601a (175515f1-40e6-4b02-a228-f369cc6f601a): created successfully Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd80e7-aa0a-468d-9224-adec3e4598e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Flow 'volume_create_manager' (0536085b-8cd8-4999-bc96-c3eb45f75c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-25de5cd8-3549-4a25-bd18-387466506eed tempest-VolumesListAdminTestJSON-873778526 None] Created volume successfully. Jul 17 07:07:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1843645c-04f8-4065-86e2-81d5c8ecba33 tempest-GroupSnapshotsTest-383038828 None] Update group completed successfully. Jul 17 07:07:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-90fb69db-9b7a-40c0-860c-08db8fdda648 tempest-GroupSnapshotsTest-383038828 None] Update group completed successfully. Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Flow 'volume_create_manager' (76d14e2c-bafd-45e6-a529-bea830e3173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf4f799-f1b9-47f5-afd8-d981a270935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf4f799-f1b9-47f5-afd8-d981a270935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01a29cb-6d43-4e07-aad4-91aec10935a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869b86b4a6564ae187c8d70509bb493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:48Z,use_quota=True,user_id='c3caf4bee18c495a91ea05ee2632dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23f88c5-8d5c-431b-b49f-0a9964c678a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23f88c5-8d5c-431b-b49f-0a9964c678a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87937fa6-1bd4-4f67-ab37-3467d6311a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87937fa6-1bd4-4f67-ab37-3467d6311a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01a29cb-6d43-4e07-aad4-91aec10935a6', 'volume_name': 'volume-f01a29cb-6d43-4e07-aad4-91aec10935a6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe81f81-57b0-4614-a6d1-7113d7a451d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe81f81-57b0-4614-a6d1-7113d7a451d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a13edd-7af3-46fc-b5a5-9dfeb3f6edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:47 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Volume f01a29cb-6d43-4e07-aad4-91aec10935a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01a29cb-6d43-4e07-aad4-91aec10935a6', 'volume_size': 1} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01a29cb-6d43-4e07-aad4-91aec10935a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869b86b4a6564ae187c8d70509bb493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:48Z,use_quota=True,user_id='c3caf4bee18c495a91ea05ee2632dd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Creating volume f01a29cb-6d43-4e07-aad4-91aec10935a6 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:47 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:47 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 1073741824 Jul 17 07:07:47 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:48 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 1073741824" returned: 0 in 0.523s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:48 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 Jul 17 07:07:48 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:48 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-efcdd426-3cd8-4c60-8e3d-62f8eb2d20a6 tempest-GroupSnapshotsTest-383038828 None] Update group completed successfully. Jul 17 07:07:48 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a13edd-7af3-46fc-b5a5-9dfeb3f6edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01a29cb-6d43-4e07-aad4-91aec10935a6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62747ca4-d636-4fd9-9a45-1d98095aea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:48 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Volume volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 (f01a29cb-6d43-4e07-aad4-91aec10935a6): created successfully Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62747ca4-d636-4fd9-9a45-1d98095aea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Flow 'volume_create_manager' (76d14e2c-bafd-45e6-a529-bea830e3173f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:48 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ce4328d3-f674-467b-a3e6-d442205aeb05 tempest-VolumesListAdminTestJSON-269554238 None] Created volume successfully. Jul 17 07:07:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4cadf9f0-9093-474b-a37a-74627454eebe tempest-GroupSnapshotsTest-383038828 None] Update group completed successfully. Jul 17 07:07:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Acquiring lock "cinder-f01a29cb-6d43-4e07-aad4-91aec10935a6-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Lock "cinder-f01a29cb-6d43-4e07-aad4-91aec10935a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Acquiring lock "cinder-quobyte-f01a29cb-6d43-4e07-aad4-91aec10935a6" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Lock "cinder-quobyte-f01a29cb-6d43-4e07-aad4-91aec10935a6" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6258da-4b33-4f70-aa47-90197bcb5fa5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "cinder-175515f1-40e6-4b02-a228-f369cc6f601a-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-175515f1-40e6-4b02-a228-f369cc6f601a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "cinder-quobyte-175515f1-40e6-4b02-a228-f369cc6f601a" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-quobyte-175515f1-40e6-4b02-a228-f369cc6f601a" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:50 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 Jul 17 07:07:50 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dceb7eb-fae8-4521-aacc-103d0f396086]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:50 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a Jul 17 07:07:50 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:50 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6" returned: 0 in 0.474s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:50 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6 Jul 17 07:07:50 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:50 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a" returned: 0 in 0.528s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:50 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a Jul 17 07:07:50 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:07:50 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Flow 'volume_create_manager' (cc604a5a-c902-4ceb-aa27-f9433e2360a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764b53fd-9088-4ccf-894d-41d64ecd7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f01a29cb-6d43-4e07-aad4-91aec10935a6" returned: 0 in 0.430s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764b53fd-9088-4ccf-894d-41d64ecd7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-25395608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b73bca-dc3e-4fbd-8915-48244377521e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88d2c4271ec4b66ab508da7d2a58b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:51Z,use_quota=True,user_id='4afc17869e114389a195efea35af9871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5b5695-8a0e-481d-a31a-afcfb38ab8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5b5695-8a0e-481d-a31a-afcfb38ab8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a830e4e-b5a4-4cb7-a683-2dc41a2c457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a830e4e-b5a4-4cb7-a683-2dc41a2c457a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b73bca-dc3e-4fbd-8915-48244377521e', 'volume_name': 'volume-c4b73bca-dc3e-4fbd-8915-48244377521e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38cf05d-e229-41bb-b31e-ec2f7180b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38cf05d-e229-41bb-b31e-ec2f7180b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2b362e-ca14-4fc1-947e-1b7659470173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:51 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Volume c4b73bca-dc3e-4fbd-8915-48244377521e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b73bca-dc3e-4fbd-8915-48244377521e', 'volume_size': 1} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-25395608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b73bca-dc3e-4fbd-8915-48244377521e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88d2c4271ec4b66ab508da7d2a58b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:07:51Z,use_quota=True,user_id='4afc17869e114389a195efea35af9871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Creating volume c4b73bca-dc3e-4fbd-8915-48244377521e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:07:51 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Lock "cinder-quobyte-f01a29cb-6d43-4e07-aad4-91aec10935a6" released by "delete_volume" :: held 1.053s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:51 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e 1073741824 Jul 17 07:07:51 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:51 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-175515f1-40e6-4b02-a228-f369cc6f601a" returned: 0 in 0.362s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-quobyte-175515f1-40e6-4b02-a228-f369cc6f601a" released by "delete_volume" :: held 0.958s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Created reservations ['8fbc2966-c250-4ee5-add8-77ac864fc379', '08e4d1a1-0562-4497-9f14-42931c77065c', '1801bd4d-f6ba-4469-ba51-04c86ab27230', '87334cc5-d44c-410b-b658-1c0880e9a2d1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] GroupSnapshot 0681af87-d464-4f81-947e-0f71a4d4dab2: creating. Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Created reservations ['8e1571b9-613c-4a6c-8418-acfc4cd0e623', '06a6bdba-1ce5-40aa-855f-1d0762d31443', 'e9f75a64-6e46-4fdd-baca-dd772c146cda', '46b6794f-2d83-40a9-a399-ff250a492e51'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Group snapshot 0681af87-d464-4f81-947e-0f71a4d4dab2: creating. {{(pid=87331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 07:07:51 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:51 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:51 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:51 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:51 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e 1073741824" returned: 0 in 0.629s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:51 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.281s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Deleted volume successfully. Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0f2d2a9f-68e7-4345-85ef-f492eb51e11d tempest-VolumesListAdminTestJSON-269554238 None] Lock "cinder-f01a29cb-6d43-4e07-aad4-91aec10935a6-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:51 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Deleted volume successfully. Jul 17 07:07:51 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e Jul 17 07:07:51 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-780c888e-a835-4e70-a339-25e523debd86 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-175515f1-40e6-4b02-a228-f369cc6f601a-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:51 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e" returned: 0 in 0.285s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.599s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2b362e-ca14-4fc1-947e-1b7659470173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b73bca-dc3e-4fbd-8915-48244377521e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a34b6e-66b0-4df6-a4fc-cc9e1df9c6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Creating offline snapshot 79875f6a-62d5-4ca7-8084-3baeab49acd5 of volume 41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:07:52 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Volume volume-c4b73bca-dc3e-4fbd-8915-48244377521e (c4b73bca-dc3e-4fbd-8915-48244377521e): created successfully Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a34b6e-66b0-4df6-a4fc-cc9e1df9c6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Flow 'volume_create_manager' (cc604a5a-c902-4ceb-aa27-f9433e2360a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[834dea78-ac52-4c45-bcdc-1c1add29c8b5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6340f6cc-3e19-4801-8f65-8f9e71450a33 tempest-AbsoluteLimitsTests-850106205 None] Created volume successfully. Jul 17 07:07:52 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 Jul 17 07:07:52 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "cinder-19feeff1-5a3a-41a6-8e35-eca7265fe1a2-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-19feeff1-5a3a-41a6-8e35-eca7265fe1a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "cinder-quobyte-19feeff1-5a3a-41a6-8e35-eca7265fe1a2" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-quobyte-19feeff1-5a3a-41a6-8e35-eca7265fe1a2" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:52 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" returned: 0 in 0.452s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b3bbd5-6f65-42ca-8d24-0cc61f829262]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:52 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 1G Jul 17 07:07:52 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:52 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 Jul 17 07:07:52 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:52 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2" returned: 0 in 0.449s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2 Jul 17 07:07:53 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 1G" returned: 0 in 0.525s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 Jul 17 07:07:53 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Acquiring lock "cinder-c4b73bca-dc3e-4fbd-8915-48244377521e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Lock "cinder-c4b73bca-dc3e-4fbd-8915-48244377521e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Acquiring lock "cinder-quobyte-c4b73bca-dc3e-4fbd-8915-48244377521e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Lock "cinder-quobyte-c4b73bca-dc3e-4fbd-8915-48244377521e" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62fb0e8-f2cc-4b9e-b4bd-59fe2b7ace8c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-19feeff1-5a3a-41a6-8e35-eca7265fe1a2" returned: 0 in 0.357s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-quobyte-19feeff1-5a3a-41a6-8e35-eca7265fe1a2" released by "delete_volume" :: held 0.852s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:53 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e Jul 17 07:07:53 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Created reservations ['96f51604-d03f-40c5-ac45-34a386545eeb', '9a57a5c0-0f44-4f89-9724-3bb08df79743', 'ab0529af-5afb-4743-bd8b-942418121457', '6c0ba875-9cf2-436e-9661-cc0cebfe4dd8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:53 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5" returned: 0 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:53 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 Jul 17 07:07:53 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:53 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e" returned: 0 in 0.439s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e Jul 17 07:07:53 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "cinder-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:53 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5" returned: 0 in 0.349s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:53 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.329s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Deleted volume successfully. Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "cinder-quobyte-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:53 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info Jul 17 07:07:53 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-quobyte-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ed1a3d19-3228-4add-acfe-41bb6c594b49 tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-19feeff1-5a3a-41a6-8e35-eca7265fe1a2-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe5dd14-08bf-4001-bcf8-cd294327a472]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:54 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c4b73bca-dc3e-4fbd-8915-48244377521e" returned: 0 in 0.399s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Lock "cinder-quobyte-c4b73bca-dc3e-4fbd-8915-48244377521e" released by "delete_volume" :: held 0.912s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:54 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 Jul 17 07:07:54 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Created reservations ['71c35a73-0ce7-419a-a15e-5dae964c1973', 'f1fe0dcb-7103-43fb-8468-7ab00a34f460', '064d45fa-4640-451d-8e3e-f514e83bd66d', '27959c75-b259-4664-82fc-2cc7a58ca13f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:54 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info" returned: 0 in 0.317s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:54 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:54 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info Jul 17 07:07:54 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:54 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:54 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:54 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012" returned: 0 in 0.492s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:54 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.info" returned: 0 in 0.305s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:54 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012 Jul 17 07:07:54 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Creating offline snapshot 84a76c48-27c1-4e52-bb81-7ff340c5dd09 of volume 826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c64c1a-9e21-4f5b-ac6d-cd5b951e8cad]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:54 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.354s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Deleted volume successfully. Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1b393c27-3300-47b8-b97e-0d26b102178e tempest-AbsoluteLimitsTests-850106205 None] Lock "cinder-c4b73bca-dc3e-4fbd-8915-48244377521e-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:54 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e Jul 17 07:07:54 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:54 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012" returned: 0 in 0.367s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-quobyte-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012" released by "delete_volume" :: held 0.919s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Created reservations ['2485dcc8-6bf2-43e1-8ecb-a9ec765e70cf', '8617cd5f-4c28-4265-906c-815d994804fa', '538438db-f8f3-456a-ad54-46c6d4fea349', '605dab89-d52a-4e98-ae83-3676aae982f1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:55 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:55 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:55 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e" returned: 0 in 0.607s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:55 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 1G Jul 17 07:07:55 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:55 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:55 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Deleted volume successfully. Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16b1392d-a0cd-4373-8c74-487440e67bed tempest-VolumesListAdminTestJSON-873778526 None] Lock "cinder-a3ad8db3-f2fb-4e9c-b034-59ccbe80e012-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:55 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 1G" returned: 0 in 0.496s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826567bc-9863-4496-8302-fdaee59f4a1e -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:55 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826567bc-9863-4496-8302-fdaee59f4a1e -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 Jul 17 07:07:55 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:56 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826567bc-9863-4496-8302-fdaee59f4a1e -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09" returned: 0 in 0.376s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:56 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:56 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 Jul 17 07:07:56 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:56 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:56 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info Jul 17 07:07:56 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:56 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info" returned: 0 in 0.297s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:56 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:07:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:56 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info Jul 17 07:07:56 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:57 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.info" returned: 0 in 0.357s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-baff9779-f224-4b5f-8372-7effc0a73d3f tempest-GroupSnapshotsTest-383038828 None] group_snapshot 0681af87-d464-4f81-947e-0f71a4d4dab2: created successfully Jul 17 07:07:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 0681af87-d464-4f81-947e-0f71a4d4dab2: deleting Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 0681af87-d464-4f81-947e-0f71a4d4dab2: deleting {{(pid=87331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 07:07:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b1479ba9-fa69-4133-9d18-9d1501a23467 tempest-GroupsV320Test-1960434852 None] Group tempest-GroupsV320Test-Group-1585436462: creating Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-79875f6a-62d5-4ca7-8084-3baeab49acd5" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b1479ba9-fa69-4133-9d18-9d1501a23467 tempest-GroupsV320Test-1960434852 None] Group tempest-GroupsV320Test-Group-1585436462: created successfully Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-79875f6a-62d5-4ca7-8084-3baeab49acd5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Deleting offline snapshot 79875f6a-62d5-4ca7-8084-3baeab49acd5 of volume 41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] snapshot_file for this snap is: volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:07:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b1479ba9-fa69-4133-9d18-9d1501a23467 tempest-GroupsV320Test-1960434852 None] Create group completed successfully. Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[702305f6-3632-484e-9c39-686eea1b3346]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:58 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 Jul 17 07:07:58 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:58 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:07:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a394e3a9-5bb8-4af1-b7b9-f32bff3c0ad0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:58 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 Jul 17 07:07:58 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:58 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" returned: 0 in 0.395s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:58 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 Jul 17 07:07:58 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:59 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5" returned: 0 in 0.423s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:59 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5 Jul 17 07:07:59 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Created reservations ['c1f80119-ab2b-4052-832d-abd990ddfd13'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:07:59 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2.79875f6a-62d5-4ca7-8084-3baeab49acd5" returned: 0 in 0.334s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-79875f6a-62d5-4ca7-8084-3baeab49acd5" released by "_delete_snapshot" :: held 1.661s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" released by "delete_snapshot" :: held 1.709s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-826567bc-9863-4496-8302-fdaee59f4a1e" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-826567bc-9863-4496-8302-fdaee59f4a1e" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-84a76c48-27c1-4e52-bb81-7ff340c5dd09" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:07:59 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:07:59 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-84a76c48-27c1-4e52-bb81-7ff340c5dd09" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Deleting offline snapshot 84a76c48-27c1-4e52-bb81-7ff340c5dd09 of volume 826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] snapshot_file for this snap is: volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af9f2e-d880-41b7-8784-a8859e5de4d8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:07:59 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 Jul 17 07:07:59 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:07:59 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.323s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:07:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:07:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f522e552-99a1-474a-8285-d14858807bb5 tempest-GroupsV320Test-1960434852 None] Delete group completed successfully. Jul 17 07:08:00 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09" returned: 0 in 0.458s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-826567bc-9863-4496-8302-fdaee59f4a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6700c77e-565f-442c-8292-0234f85cd629]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:00 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e Jul 17 07:08:00 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:00 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e" returned: 0 in 0.420s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:00 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 Jul 17 07:08:00 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:01 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09" returned: 0 in 0.638s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:01 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09 Jul 17 07:08:01 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=114,cinder:UPDATE=151,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=128,cinder:INSERT=32,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Flow 'volume_create_manager' (1670b8bd-8a3d-4172-9ffb-a543795e1a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52975c-c439-473c-8718-a2bfed8622d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52975c-c439-473c-8718-a2bfed8622d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1465769385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca431d1-0938-443f-b52c-12a1d82591ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae0bbe692334a51a525110e29b13149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:01Z,use_quota=True,user_id='6b6b2125be8845d7b44801a4f9dc05ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d23e16-b57f-4ac0-b3e7-9a3d32a8f3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d23e16-b57f-4ac0-b3e7-9a3d32a8f3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abdf4f2-2e84-4bfc-ba61-b9878399de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abdf4f2-2e84-4bfc-ba61-b9878399de10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca431d1-0938-443f-b52c-12a1d82591ab', 'volume_name': 'volume-dca431d1-0938-443f-b52c-12a1d82591ab', 'volume_size': 2}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01bf15c-08e9-4a5c-b561-0d428d6502ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:01 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01bf15c-08e9-4a5c-b561-0d428d6502ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a455ace0-820e-47fd-831a-35d26ef1c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:01 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Volume dca431d1-0938-443f-b52c-12a1d82591ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca431d1-0938-443f-b52c-12a1d82591ab', 'volume_size': 2} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1465769385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca431d1-0938-443f-b52c-12a1d82591ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae0bbe692334a51a525110e29b13149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:01Z,use_quota=True,user_id='6b6b2125be8845d7b44801a4f9dc05ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Creating volume dca431d1-0938-443f-b52c-12a1d82591ab {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:01 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab 2147483648 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e.84a76c48-27c1-4e52-bb81-7ff340c5dd09" returned: 0 in 0.334s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:01 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab 2147483648 Jul 17 07:08:01 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-84a76c48-27c1-4e52-bb81-7ff340c5dd09" released by "_delete_snapshot" :: held 1.991s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-826567bc-9863-4496-8302-fdaee59f4a1e" released by "delete_snapshot" :: held 2.019s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:01 devstack cinder-volume[87331]: WARNING cinder.quota [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1450350551 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1450350551, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:01 devstack cinder-volume[87331]: WARNING cinder.quota [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1450350551 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1450350551, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['ee795c86-acc8-47b6-a115-952275c8b69a', 'd58509e6-ea4d-450f-b8d7-07a627707983', '88304c41-a240-4225-a76c-a3d3ff3aba33', '73a044ca-6eca-475a-9684-b2247fcfe6bc'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:01 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['a12112cb-17c1-400f-b765-55bbcf6a62f6', '48cd8415-b3aa-4d29-9d74-0a8b9673d9ca', '66f14d73-65b4-4c34-aa58-742ee4211e83', '8d62e8c6-35b1-4804-9435-bfb8613e3d42'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:02 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-08d076bd-5295-4433-acdf-47aa8ade8c75 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 0681af87-d464-4f81-947e-0f71a4d4dab2: deleted successfully Jul 17 07:08:02 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab 2147483648" returned: 0 in 0.581s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:02 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab Jul 17 07:08:02 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:02 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a455ace0-820e-47fd-831a-35d26ef1c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca431d1-0938-443f-b52c-12a1d82591ab', 'volume_size': 2}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39beadf-c1e5-4c0f-983b-6f35d5153da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:02 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Volume volume-dca431d1-0938-443f-b52c-12a1d82591ab (dca431d1-0938-443f-b52c-12a1d82591ab): created successfully Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39beadf-c1e5-4c0f-983b-6f35d5153da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Flow 'volume_create_manager' (1670b8bd-8a3d-4172-9ffb-a543795e1a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:02 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-558332ea-447d-4e36-9439-00c98496eaef tempest-VolumesCloneNegativeTest-1376930955 None] Created volume successfully. Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f73dcd0-d822-4faf-8018-6bed48b1a21b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:03 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 Jul 17 07:08:03 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Flow 'volume_create_manager' (2c6e5eb6-0b01-40bd-afb6-1c2d23c30945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8418d61-d46d-4f51-995b-d1bed29f4a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8418d61-d46d-4f51-995b-d1bed29f4a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082005188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b792eb3-b6a6-407f-b177-7eea403c5049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d34db0a11284926b83f16469a6ffe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:03Z,use_quota=True,user_id='31200cb49f44469a8b3b493f3c642815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95253ae7-f87c-4eed-974d-1895ad1ed0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95253ae7-f87c-4eed-974d-1895ad1ed0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:03 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ebe86e-b9ff-42a5-9451-c8102ae7e950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ebe86e-b9ff-42a5-9451-c8102ae7e950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b792eb3-b6a6-407f-b177-7eea403c5049', 'volume_name': 'volume-4b792eb3-b6a6-407f-b177-7eea403c5049', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e8f7a7-8d57-4d45-bb72-2951a15b2b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e8f7a7-8d57-4d45-bb72-2951a15b2b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341f2962-ef1c-4881-8222-220acd6c096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:03 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Volume 4b792eb3-b6a6-407f-b177-7eea403c5049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b792eb3-b6a6-407f-b177-7eea403c5049', 'volume_size': 1} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082005188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b792eb3-b6a6-407f-b177-7eea403c5049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d34db0a11284926b83f16469a6ffe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:03Z,use_quota=True,user_id='31200cb49f44469a8b3b493f3c642815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Creating volume 4b792eb3-b6a6-407f-b177-7eea403c5049 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:03 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" returned: 0 in 0.491s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:03 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 1073741824 Jul 17 07:08:03 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:03 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2 Jul 17 07:08:03 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Acquiring lock "cinder-dca431d1-0938-443f-b52c-12a1d82591ab-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Lock "cinder-dca431d1-0938-443f-b52c-12a1d82591ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Acquiring lock "cinder-quobyte-dca431d1-0938-443f-b52c-12a1d82591ab" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:03 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" returned: 0 in 0.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Lock "cinder-quobyte-dca431d1-0938-443f-b52c-12a1d82591ab" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-41803e9a-9f54-4dd1-8dda-6c59c13ae7e2" released by "delete_volume" :: held 0.918s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-826567bc-9863-4496-8302-fdaee59f4a1e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7f0fa-db63-4d4b-b52d-687b01db55f1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-826567bc-9863-4496-8302-fdaee59f4a1e" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f186225-7b63-4628-822b-6736bca09e73]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:04 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab Jul 17 07:08:04 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:04 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e Jul 17 07:08:04 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:04 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 1073741824" returned: 0 in 0.676s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:04 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 Jul 17 07:08:04 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:04 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e" returned: 0 in 0.505s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:04 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e Jul 17 07:08:04 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:04 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab" returned: 0 in 0.648s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:04 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab Jul 17 07:08:04 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:04 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049" returned: 0 in 0.352s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341f2962-ef1c-4881-8222-220acd6c096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b792eb3-b6a6-407f-b177-7eea403c5049', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7550c1-3bb7-4edb-a072-428c5d2b0b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:04 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Volume volume-4b792eb3-b6a6-407f-b177-7eea403c5049 (4b792eb3-b6a6-407f-b177-7eea403c5049): created successfully Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7550c1-3bb7-4edb-a072-428c5d2b0b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Flow 'volume_create_manager' (2c6e5eb6-0b01-40bd-afb6-1c2d23c30945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:04 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-081891fd-615e-448f-a069-896dd65c1841 tempest-VolumesListTestJSON-1252094782 None] Created volume successfully. Jul 17 07:08:04 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-826567bc-9863-4496-8302-fdaee59f4a1e" returned: 0 in 0.285s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-826567bc-9863-4496-8302-fdaee59f4a1e" released by "delete_volume" :: held 0.877s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:04 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dca431d1-0938-443f-b52c-12a1d82591ab" returned: 0 in 0.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Lock "cinder-quobyte-dca431d1-0938-443f-b52c-12a1d82591ab" released by "delete_volume" :: held 0.970s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['c3233a60-bb10-486c-b9e8-0ccba416b9f2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Created reservations ['089d7d05-b78f-45a3-8567-310d98f910c9', '3e544bc1-f352-4efd-b19f-65839692f0fe', '718d41c7-b93a-46f9-b356-8135bb1f3ff0', 'ddcb80d0-1ab0-4dd8-942e-b2de9397367d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:04 devstack cinder-volume[87331]: WARNING cinder.quota [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1450350551 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1450350551, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['bcbe5d73-6d38-4b57-a2a9-0258cd3f1d84', '113d7ec2-76e5-4c2e-b2a2-ae0de9b21119', '5c90a5d4-a60f-4765-8d8a-79f6cdce7e2a', 'a1c64562-009a-475b-9287-b29b451ba7b1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:05 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:05 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['ec6cdb93-09f8-4781-a6ab-4fce122a4b94', '02b992e8-4af6-40a4-8858-726cd016bb81', '59840376-565d-4818-b8c7-aad36c82548e', '9ffccb90-7d4c-4ca0-872c-4cfb48c4c3c6'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:05 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Deleted volume successfully. Jul 17 07:08:05 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:05 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-da8603c3-b3d4-4195-b43c-79fc97f879e7 tempest-VolumesCloneNegativeTest-1376930955 None] Lock "cinder-dca431d1-0938-443f-b52c-12a1d82591ab-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:05 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:05 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2f3312e7-b5f7-4b7c-88e9-ef55f3f7e1b1 tempest-GroupSnapshotsTest-383038828 None] Delete group completed successfully. Jul 17 07:08:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9beb6ddb-b5b1-4249-a26e-ca349bc1ed0b tempest-GroupSnapshotsTest-383038828 None] Group tempest-GroupSnapshotsTest-Group-757562061: creating Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Flow 'volume_create_manager' (f876f356-7aa7-419d-ac62-049a83742974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fcefd34-0f21-40c0-9195-1541506fc864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fcefd34-0f21-40c0-9195-1541506fc864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-637223374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11886c6-9745-405e-968f-62f5ee607dba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d34db0a11284926b83f16469a6ffe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:06Z,use_quota=True,user_id='31200cb49f44469a8b3b493f3c642815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fc4992-b807-4634-900b-58dd9f31881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fc4992-b807-4634-900b-58dd9f31881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5431c7-6e53-482a-bf28-37c269666126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5431c7-6e53-482a-bf28-37c269666126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11886c6-9745-405e-968f-62f5ee607dba', 'volume_name': 'volume-d11886c6-9745-405e-968f-62f5ee607dba', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2110ef-829b-4d8d-82ec-a0a7e218687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2110ef-829b-4d8d-82ec-a0a7e218687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef0c552-f30a-4325-a0d2-28001256c0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:06 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Volume d11886c6-9745-405e-968f-62f5ee607dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11886c6-9745-405e-968f-62f5ee607dba', 'volume_size': 1} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-637223374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11886c6-9745-405e-968f-62f5ee607dba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d34db0a11284926b83f16469a6ffe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:06Z,use_quota=True,user_id='31200cb49f44469a8b3b493f3c642815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Creating volume d11886c6-9745-405e-968f-62f5ee607dba {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:06 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9beb6ddb-b5b1-4249-a26e-ca349bc1ed0b tempest-GroupSnapshotsTest-383038828 None] Group tempest-GroupSnapshotsTest-Group-757562061: created successfully Jul 17 07:08:06 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba 1073741824 Jul 17 07:08:06 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9beb6ddb-b5b1-4249-a26e-ca349bc1ed0b tempest-GroupSnapshotsTest-383038828 None] Create group completed successfully. Jul 17 07:08:06 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba 1073741824" returned: 0 in 0.505s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:06 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba Jul 17 07:08:06 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Flow 'volume_create_manager' (48f7c48e-3c83-45f1-82d7-ff91e56edba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33829842-095a-4d14-be19-05dbc160d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33829842-095a-4d14-be19-05dbc160d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-715779650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2184367-0568-4b12-8f81-7a5f3bfe68fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ce62f17fd5443881e77a52260b9bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:07Z,use_quota=True,user_id='844f831568374202b2b072bdd1704f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8f185a-19ac-4ff8-af3c-f34d625c78c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8f185a-19ac-4ff8-af3c-f34d625c78c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd8b2d1-ed31-41e7-b925-28986557b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd8b2d1-ed31-41e7-b925-28986557b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2184367-0568-4b12-8f81-7a5f3bfe68fe', 'volume_name': 'volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c995d0f-5c5f-4cc8-8962-dfcc5755046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c995d0f-5c5f-4cc8-8962-dfcc5755046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52793247-4b73-45de-82e6-05f15f25b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Volume e2184367-0568-4b12-8f81-7a5f3bfe68fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe', 'volume_size': 1} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba" returned: 0 in 0.401s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-715779650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2184367-0568-4b12-8f81-7a5f3bfe68fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ce62f17fd5443881e77a52260b9bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:07Z,use_quota=True,user_id='844f831568374202b2b072bdd1704f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Creating volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:07 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef0c552-f30a-4325-a0d2-28001256c0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11886c6-9745-405e-968f-62f5ee607dba', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489dcda1-9f13-444a-bf04-23666ca919e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe 1073741824 Jul 17 07:08:07 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Volume volume-d11886c6-9745-405e-968f-62f5ee607dba (d11886c6-9745-405e-968f-62f5ee607dba): created successfully Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489dcda1-9f13-444a-bf04-23666ca919e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Flow 'volume_create_manager' (f876f356-7aa7-419d-ac62-049a83742974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1a980f13-e1cd-46a9-a193-716d1b89b616 tempest-VolumesListTestJSON-1252094782 None] Created volume successfully. Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (0a28defa-ba86-432b-966a-431c827e73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dfe629-4f3f-4519-9bda-b94a8859c482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19dfe629-4f3f-4519-9bda-b94a8859c482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919401540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=862b1532-a314-4837-b5f7-19dc4c77b9ee,host='devstack@QuobyteHD#QuobyteHD',id=6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:08Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(606fd8d7-c480-4399-9417-e20adcd89dbb),volume_type_id=606fd8d7-c480-4399-9417-e20adcd89dbb)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35278e81-7dd3-4b10-b160-d24ac0478706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35278e81-7dd3-4b10-b160-d24ac0478706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09cb0b6-f3ef-4aed-ba77-a78cdb7f0f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09cb0b6-f3ef-4aed-ba77-a78cdb7f0f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8', 'volume_name': 'volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e711f98-b257-43d6-afae-f71c6c70e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e711f98-b257-43d6-afae-f71c6c70e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d369f3fc-0730-46b1-9225-991bd35bde49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Volume 6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8', 'volume_size': 1} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:07 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe 1073741824" returned: 0 in 0.539s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:07 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe Jul 17 07:08:07 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:08 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=862b1532-a314-4837-b5f7-19dc4c77b9ee,created_at=2026-07-17T05:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919401540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=862b1532-a314-4837-b5f7-19dc4c77b9ee,host='devstack@QuobyteHD#QuobyteHD',id=6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d7ceb6a61d41f3944e28e3ec0661d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:08Z,use_quota=True,user_id='f0353681b27e4d418b4aaad1e826ee0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(606fd8d7-c480-4399-9417-e20adcd89dbb),volume_type_id=606fd8d7-c480-4399-9417-e20adcd89dbb)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Creating volume 6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:08 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52793247-4b73-45de-82e6-05f15f25b974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3b4fe5-97ba-4e99-86ce-9137039b7d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:08 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 1073741824 Jul 17 07:08:08 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Volume volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe (e2184367-0568-4b12-8f81-7a5f3bfe68fe): created successfully Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3b4fe5-97ba-4e99-86ce-9137039b7d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Flow 'volume_create_manager' (48f7c48e-3c83-45f1-82d7-ff91e56edba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:08 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2c41befe-a5d9-407e-832f-57f5561745d3 tempest-SnapshotsActionsTest-423040830 None] Created volume successfully. Jul 17 07:08:08 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 1073741824" returned: 0 in 0.525s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:08 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 Jul 17 07:08:08 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Flow 'volume_create_manager' (17194e9c-4033-4069-8316-c7ecc4109fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ce060f-83e2-4d84-886a-b6172e3b7a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ce060f-83e2-4d84-886a-b6172e3b7a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810395049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2514ee61-3ad3-42be-9dd3-9c3f170d3c53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d34db0a11284926b83f16469a6ffe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:09Z,use_quota=True,user_id='31200cb49f44469a8b3b493f3c642815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6095c117-59ee-467c-bde9-252cb92cc009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6095c117-59ee-467c-bde9-252cb92cc009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568873a5-c1c1-4601-a3f6-92ab0e528515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568873a5-c1c1-4601-a3f6-92ab0e528515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2514ee61-3ad3-42be-9dd3-9c3f170d3c53', 'volume_name': 'volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d03d04-4e77-4a04-bb40-ee4d295e6553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d03d04-4e77-4a04-bb40-ee4d295e6553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cc0162-a757-4244-a887-dc22c7a60756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Volume 2514ee61-3ad3-42be-9dd3-9c3f170d3c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53', 'volume_size': 1} Jul 17 07:08:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:09 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810395049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2514ee61-3ad3-42be-9dd3-9c3f170d3c53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d34db0a11284926b83f16469a6ffe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:09Z,use_quota=True,user_id='31200cb49f44469a8b3b493f3c642815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Creating volume 2514ee61-3ad3-42be-9dd3-9c3f170d3c53 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:09 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d369f3fc-0730-46b1-9225-991bd35bde49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:09 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 1073741824 Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a080c41a-9689-4978-ba61-9bbbf821a41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:09 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Volume volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 (6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8): created successfully Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a080c41a-9689-4978-ba61-9bbbf821a41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Flow 'volume_create_manager' (0a28defa-ba86-432b-966a-431c827e73d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3d23ed7f-125e-42c9-8084-82f50eb25f1b tempest-GroupSnapshotsTest-383038828 None] Created volume successfully. Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:09 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 1073741824" returned: 0 in 0.500s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:09 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 Jul 17 07:08:09 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:09 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Flow 'volume_create_manager' (86909253-673c-4f0a-8d9f-3fb8524537f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a00265-0c20-4de6-9490-622110258981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53" returned: 0 in 0.280s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.414s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a00265-0c20-4de6-9490-622110258981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1778584022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215c5f76-6d2a-4a06-8370-1bbc28c6c7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468bb4d06c2f4d4e862f8fd644923507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:10Z,use_quota=True,user_id='64059194f48348fabcd5d457af878a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccd4613-c4a1-4b3f-b06d-ad39cc04777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccd4613-c4a1-4b3f-b06d-ad39cc04777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c478c0-e61c-48e8-940e-d7d390e5ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cc0162-a757-4244-a887-dc22c7a60756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9798078-e2d1-48ed-8d1d-4f072c6da0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Creating offline snapshot d01b602c-ebd1-4811-94cd-aa72db1c6685 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Volume volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 (2514ee61-3ad3-42be-9dd3-9c3f170d3c53): created successfully Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9798078-e2d1-48ed-8d1d-4f072c6da0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Flow 'volume_create_manager' (17194e9c-4033-4069-8316-c7ecc4109fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a6d7d3-4975-4295-8efa-00d8eb38c823]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0167d92d-1f7a-4bdb-859f-e5de8d486b9b tempest-VolumesListTestJSON-1252094782 None] Created volume successfully. Jul 17 07:08:10 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe Jul 17 07:08:10 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c478c0-e61c-48e8-940e-d7d390e5ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '215c5f76-6d2a-4a06-8370-1bbc28c6c7e7', 'volume_name': 'volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73905ebc-7a20-4fef-8764-9a1ede999237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73905ebc-7a20-4fef-8764-9a1ede999237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85493d53-506f-4223-bcf5-ffb91e05323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Volume 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Trying to clone 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 from image d615f633-2881-4d59-aa2e-ff4db61859d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:08:10 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:10 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 1G Jul 17 07:08:10 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] GroupSnapshot 8259bba7-f2bb-430b-ad4d-05ff30ef6f33: creating. Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Group snapshot 8259bba7-f2bb-430b-ad4d-05ff30ef6f33: creating. {{(pid=87331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:08:10 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Image download 20.69 MB at 20.69 MB/s Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[74328857-3e0a-42cf-82d0-6f99d9fd2dd7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:10 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD Jul 17 07:08:10 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:10 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 1G" returned: 0 in 0.528s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:10 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:10 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:11 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 is fetched for user 64059194f48348fabcd5d457af878a05. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a018c1-2099-49b9-ad2e-1cb0ba1ef17c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:11 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.325s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:11 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 is being set with open permissions: ugo+rw Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:11 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:11 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:11 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD Jul 17 07:08:11 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:11 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:11 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:11 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info Jul 17 07:08:11 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:11 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:11 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info is being set with open permissions: ugo+rw Jul 17 07:08:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:11 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info Jul 17 07:08:11 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:12 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.info" returned: 0 in 0.253s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.573s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Creating offline snapshot 3879d754-5d78-4be8-907d-f656324b8bf5 of volume 6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:12 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-41a74a55-99be-4283-922d-ed8588f7dcad tempest-SnapshotsActionsTest-423040830 None] Create snapshot completed successfully Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3729606-a5fd-4831-a589-5e0535d3ea19]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:12 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 Jul 17 07:08:12 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:12 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" returned: 0 in 0.365s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:12 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 1G Jul 17 07:08:12 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "cinder-2514ee61-3ad3-42be-9dd3-9c3f170d3c53-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-2514ee61-3ad3-42be-9dd3-9c3f170d3c53-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "cinder-quobyte-2514ee61-3ad3-42be-9dd3-9c3f170d3c53" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:13 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 1G" returned: 0 in 0.508s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-quobyte-2514ee61-3ad3-42be-9dd3-9c3f170d3c53" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:13 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 Jul 17 07:08:13 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f348fd4-03e9-42c7-bb91-8354ba981597]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 Jul 17 07:08:13 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:13 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:13 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 Jul 17 07:08:13 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:13 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53" returned: 0 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53 Jul 17 07:08:13 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:13 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5" returned: 0 in 0.242s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info Jul 17 07:08:13 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:13 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2514ee61-3ad3-42be-9dd3-9c3f170d3c53" returned: 0 in 0.242s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-quobyte-2514ee61-3ad3-42be-9dd3-9c3f170d3c53" released by "delete_volume" :: held 0.667s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Created reservations ['1d5a6b24-7268-4335-b271-4b23d28fe823', 'c0698e74-ba3d-45ec-b7ef-afc766f91170', '0abff80d-cec5-496e-95c2-bec2ec927e28', '016106e7-8aae-4ede-bfcc-e8d452cb1eb2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:13 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:13 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info" returned: 0 in 0.253s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:13 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:08:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:13 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info Jul 17 07:08:13 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:14 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Deleted volume successfully. Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8d74534b-7b3c-47b6-bec7-a3de930cbb8a tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-2514ee61-3ad3-42be-9dd3-9c3f170d3c53-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:14 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.info" returned: 0 in 0.284s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.623s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1778584022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215c5f76-6d2a-4a06-8370-1bbc28c6c7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468bb4d06c2f4d4e862f8fd644923507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:10Z,use_quota=True,user_id='64059194f48348fabcd5d457af878a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Creating volume 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:14 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "cinder-d11886c6-9745-405e-968f-62f5ee607dba-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:14 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 1073741824 Jul 17 07:08:14 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-d11886c6-9745-405e-968f-62f5ee607dba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "cinder-quobyte-d11886c6-9745-405e-968f-62f5ee607dba" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-71f5c18f-1d26-432f-8fee-fe969b3190ad tempest-GroupSnapshotsTest-383038828 None] group_snapshot 8259bba7-f2bb-430b-ad4d-05ff30ef6f33: created successfully Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-quobyte-d11886c6-9745-405e-968f-62f5ee607dba" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de3777-1775-43a1-9714-146bd3e60e22]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:14 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba Jul 17 07:08:14 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:14 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 1073741824" returned: 0 in 0.413s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:14 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 Jul 17 07:08:14 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:14 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba" returned: 0 in 0.376s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:14 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba Jul 17 07:08:14 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 8259bba7-f2bb-430b-ad4d-05ff30ef6f33: deleting Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 8259bba7-f2bb-430b-ad4d-05ff30ef6f33: deleting {{(pid=87331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-3879d754-5d78-4be8-907d-f656324b8bf5" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:14 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" returned: 0 in 0.296s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.721s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-3879d754-5d78-4be8-907d-f656324b8bf5" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Deleting offline snapshot 3879d754-5d78-4be8-907d-f656324b8bf5 of volume 6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] snapshot_file for this snap is: volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Attempting download of d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a195a-0c89-47d2-ae8e-b9454e6ce5d8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Creating offline snapshot 02d3d177-2423-4ea3-aabb-03d6f40647a3 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:15 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d11886c6-9745-405e-968f-62f5ee607dba" returned: 0 in 0.376s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3f363-327a-4d68-92e0-270896d895a9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e0ce1-b7af-493f-a6ad-5a2fe634ce73]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-quobyte-d11886c6-9745-405e-968f-62f5ee607dba" released by "delete_volume" :: held 0.832s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:15 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 Jul 17 07:08:15 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Created reservations ['856dffff-f2e3-4d41-b6d3-5be04dd413dd', 'b3f10e06-0e5a-4550-a280-c1ef35680c9d', 'dbfe88d2-a2f5-4307-b1ab-00256684317c', '4525039d-45ea-4e06-a79a-fe475468e835'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:15 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:15 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u Jul 17 07:08:15 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:15 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "cinder-4b792eb3-b6a6-407f-b177-7eea403c5049-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-4b792eb3-b6a6-407f-b177-7eea403c5049-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:15 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5" returned: 0 in 0.545s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4eda0e-676b-4405-904e-4a4ce1da6abe]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u" returned: 0 in 0.498s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "cinder-quobyte-4b792eb3-b6a6-407f-b177-7eea403c5049" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.366s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:15 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.554s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-quobyte-4b792eb3-b6a6-407f-b177-7eea403c5049" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:15 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Deleted volume successfully. Jul 17 07:08:15 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 1G Jul 17 07:08:15 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f624b9-a760-48ca-9de9-1c3f2ecb37e6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:15 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 Jul 17 07:08:15 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u Jul 17 07:08:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8919bea7-9ded-45a6-b5e2-d3d3588e1c51 tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-d11886c6-9745-405e-968f-62f5ee607dba-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:15 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:15 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 Jul 17 07:08:15 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u" returned: 1 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_uvn1p56u' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6a152-fe8c-4884-8bcc-5f9a49501206]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" returned: 0 in 0.445s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 Jul 17 07:08:16 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD Jul 17 07:08:16 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 1G" returned: 0 in 0.546s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049" returned: 0 in 0.509s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 Jul 17 07:08:16 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049 Jul 17 07:08:16 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] d615f633-2881-4d59-aa2e-ff4db61859d1 was qcow2, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5" returned: 0 in 0.408s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 Jul 17 07:08:16 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5 Jul 17 07:08:16 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4b792eb3-b6a6-407f-b177-7eea403c5049" returned: 0 in 0.297s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-quobyte-4b792eb3-b6a6-407f-b177-7eea403c5049" released by "delete_volume" :: held 0.854s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:16 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3" returned: 0 in 0.341s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 is being set with open permissions: ugo+rw Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 Jul 17 07:08:16 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Created reservations ['3206064d-f5c6-4d17-ac58-393292efff66', 'ef7cd304-182d-41d5-bad3-1ccfbfc78653', '0bee70bd-343d-41ad-9fc2-5e39a06e8c18', 'a1b22769-79c8-4897-ab07-8738628c4afa'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:16 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:16 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:16 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8.3879d754-5d78-4be8-907d-f656324b8bf5" returned: 0 in 0.349s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-3879d754-5d78-4be8-907d-f656324b8bf5" released by "_delete_snapshot" :: held 1.884s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:16 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" released by "delete_snapshot" :: held 1.949s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d11fa2f0-6349-4834-9bae-2e0bf3fd0a23 tempest-SnapshotsActionsTest-423040830 None] Create snapshot completed successfully Jul 17 07:08:17 devstack cinder-volume[87331]: WARNING cinder.quota [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-406237995 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-406237995, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:17 devstack cinder-volume[87331]: WARNING cinder.quota [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-406237995 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-406237995, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] Created reservations ['638dd68c-24a9-4453-85b2-2f7cecd8f073', 'e33f2372-cddd-47a9-b348-c6ece27a54b9', '394f0e97-fcc8-4194-ba85-b2cce160910a', 'cf05436c-ce86-401b-bcfa-b505989796a0'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:17 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Deleted volume successfully. Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9146594b-972a-44f9-9212-3fe5fd4ed11b tempest-VolumesListTestJSON-1252094782 None] Lock "cinder-4b792eb3-b6a6-407f-b177-7eea403c5049-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70a683b1-e327-4016-9387-2b8acc13d135 tempest-GroupSnapshotsTest-383038828 None] group_snapshot 8259bba7-f2bb-430b-ad4d-05ff30ef6f33: deleted successfully Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-02d3d177-2423-4ea3-aabb-03d6f40647a3-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "cinder-quobyte-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-02d3d177-2423-4ea3-aabb-03d6f40647a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-02d3d177-2423-4ea3-aabb-03d6f40647a3" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-02d3d177-2423-4ea3-aabb-03d6f40647a3" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Deleting offline snapshot 02d3d177-2423-4ea3-aabb-03d6f40647a3 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] snapshot_file for this snap is: volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec0ad5-a446-4e0d-9fb3-c4ab426c6023]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b6b630-a512-4b03-a736-a534da6be4e9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:17 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 Jul 17 07:08:17 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:18 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 Jul 17 07:08:18 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:18 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" returned: 0 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:18 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8 Jul 17 07:08:18 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:18 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3" returned: 0 in 0.588s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d8942-4c20-4da2-8999-7393657c2ab8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:18 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:18 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:18 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" returned: 0 in 0.359s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Lock "cinder-quobyte-6bbe3b50-4b5b-44cc-9432-cebc20f4f7f8" released by "delete_volume" :: held 0.916s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Created reservations ['d10f4bbb-85dc-4662-abf8-fb9d7d2d6fa9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:18 devstack cinder-volume[87331]: WARNING cinder.quota [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-406237995 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-406237995, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Created reservations ['9a67b434-40b1-4ad4-99b1-7606484c0503', '1c6bc1d5-31ea-43e8-a4dd-5e7ea0d000e5', '4bb908a6-d395-470f-a573-b986c8f0bdac', 'b79fedbb-97ac-4954-9512-3261448f8fe9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:18 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" returned: 0 in 2.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ybgj_z89devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:08:18 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Converted 112.00 MB image at 46.89 MB/s Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:18 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:18 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 1G Jul 17 07:08:18 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.472s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:18 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 Jul 17 07:08:18 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:19 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:19 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:19 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 1G" returned: 0 in 0.386s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Downloaded image d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 for user 64059194f48348fabcd5d457af878a05 is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Marking volume 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Copying metadata from image d615f633-2881-4d59-aa2e-ff4db61859d1 to 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Creating volume glance metadata for volume 215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 backed by image d615f633-2881-4d59-aa2e-ff4db61859d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:08:19 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f2c792b9-b1a7-4661-9716-b4700112365f tempest-GroupSnapshotsTest-383038828 None] Delete group completed successfully. Jul 17 07:08:19 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3" returned: 0 in 0.454s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:19 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3 Jul 17 07:08:19 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85493d53-506f-4223-bcf5-ffb91e05323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b19ef4a-804f-4b5c-8a3e-ec649a12decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Volume volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 (215c5f76-6d2a-4a06-8370-1bbc28c6c7e7): created successfully Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b19ef4a-804f-4b5c-8a3e-ec649a12decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Flow 'volume_create_manager' (86909253-673c-4f0a-8d9f-3fb8524537f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ae5f013d-da8b-4afc-952e-ca4d820af5d3 tempest-VolumesExtendTest-991137069 None] Created volume successfully. Jul 17 07:08:19 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.02d3d177-2423-4ea3-aabb-03d6f40647a3" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-02d3d177-2423-4ea3-aabb-03d6f40647a3" released by "_delete_snapshot" :: held 1.892s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" released by "delete_snapshot" :: held 1.969s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Created reservations ['168eb39d-5a70-40f3-95e1-a8455c277382', '15990ee9-fdc9-466d-8a93-dbfc6ede7b57', '7e4bf429-3df9-4684-a1aa-3741bdd2df5c', 'abb0b76a-8080-42b9-8854-8e40d30df97f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Delete snapshot completed successfully. Jul 17 07:08:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcae1e3d-d5b8-460d-af41-b2d24bfecd6d tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-02d3d177-2423-4ea3-aabb-03d6f40647a3-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693a76c-7441-4be0-b7fe-fd9da77ca1c7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:20 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 Jul 17 07:08:20 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:21 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" returned: 0 in 0.533s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 2G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 2G" returned: 0 in 0.139s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.701s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.097s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Creating offline snapshot 7d37858b-b165-4ec9-abdc-89c803720c07 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8826fd02-8c75-4731-9af1-f78257252461]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4a5bff1e-3de9-455d-89dc-39f171476752 tempest-VolumesExtendTest-991137069 None] Extend volume completed successfully. Jul 17 07:08:21 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:21 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:21 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:22 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 1G Jul 17 07:08:22 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Lock "cinder-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-quobyte-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c881231-4b08-410e-beda-ef7ff87a7a9b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:22 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 Jul 17 07:08:22 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:22 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 1G" returned: 0 in 0.712s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:22 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 Jul 17 07:08:22 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:22 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" returned: 0 in 0.489s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:22 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7 Jul 17 07:08:22 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:23 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:23 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 is being set with open permissions: ugo+rw Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:23 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 Jul 17 07:08:23 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:23 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" returned: 0 in 0.328s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7" released by "delete_volume" :: held 0.886s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Created reservations ['02f6fe74-95d5-4d36-809a-a80b0f1ed8c4', '936e2bf2-2918-460c-8780-dde1a9f99bea', '23586b7e-ace9-4d47-9b1b-43bc6000d110', '4bf5eca8-ee83-4d4e-9f4f-a018cd1d09e5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:23 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07" returned: 0 in 0.314s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:23 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:23 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2d5c1e2c-5a88-454d-a1c0-ceaa243b0639 tempest-SnapshotsActionsTest-423040830 None] Create snapshot completed successfully Jul 17 07:08:23 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.313s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Deleted volume successfully. Jul 17 07:08:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a0493cae-5a64-4f66-aab0-6b5c080b1640 tempest-VolumesExtendTest-991137069 None] Lock "cinder-215c5f76-6d2a-4a06-8370-1bbc28c6c7e7-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Flow 'volume_create_manager' (7954e0d4-19f1-407d-af2e-b80d7c5c64f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3aa8354-2055-44a1-8e11-5ab6b3915d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3aa8354-2055-44a1-8e11-5ab6b3915d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-179543763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b947e1b-f684-4057-a802-4a49575ed7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468bb4d06c2f4d4e862f8fd644923507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:24Z,use_quota=True,user_id='64059194f48348fabcd5d457af878a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949d0881-f393-4547-8ef2-7094d686d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949d0881-f393-4547-8ef2-7094d686d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25a40a8-ec46-443e-8fba-bde9bd3d4a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25a40a8-ec46-443e-8fba-bde9bd3d4a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b947e1b-f684-4057-a802-4a49575ed7b7', 'volume_name': 'volume-7b947e1b-f684-4057-a802-4a49575ed7b7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40977aa1-1b71-4c45-961e-61d9c93fe027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40977aa1-1b71-4c45-961e-61d9c93fe027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cdcc70-c3f6-4410-a147-369eea96f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:24 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Volume 7b947e1b-f684-4057-a802-4a49575ed7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b947e1b-f684-4057-a802-4a49575ed7b7', 'volume_size': 1} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-179543763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b947e1b-f684-4057-a802-4a49575ed7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468bb4d06c2f4d4e862f8fd644923507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:24Z,use_quota=True,user_id='64059194f48348fabcd5d457af878a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Creating volume 7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:24 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:24 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 1073741824 Jul 17 07:08:24 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-7d37858b-b165-4ec9-abdc-89c803720c07-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-7d37858b-b165-4ec9-abdc-89c803720c07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-7d37858b-b165-4ec9-abdc-89c803720c07" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-7d37858b-b165-4ec9-abdc-89c803720c07" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Deleting offline snapshot 7d37858b-b165-4ec9-abdc-89c803720c07 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] snapshot_file for this snap is: volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7360c980-abf9-4754-baf5-b3040f177df9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:24 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 1073741824" returned: 0 in 0.545s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:24 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 Jul 17 07:08:24 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:24 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 Jul 17 07:08:24 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:25 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7" returned: 0 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cdcc70-c3f6-4410-a147-369eea96f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b947e1b-f684-4057-a802-4a49575ed7b7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cd99f0-5ca2-448f-a10d-ccbb9b52bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:25 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Volume volume-7b947e1b-f684-4057-a802-4a49575ed7b7 (7b947e1b-f684-4057-a802-4a49575ed7b7): created successfully Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cd99f0-5ca2-448f-a10d-ccbb9b52bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Flow 'volume_create_manager' (7954e0d4-19f1-407d-af2e-b80d7c5c64f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b6d47288-1168-4760-a763-5f61e5ad02e9 tempest-VolumesExtendTest-991137069 None] Created volume successfully. Jul 17 07:08:25 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07" returned: 0 in 0.542s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2d035e-a68c-4d3e-822e-a2e301705e1a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:25 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:25 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:25 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.404s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:25 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 Jul 17 07:08:25 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:26 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07" returned: 0 in 0.610s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:26 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07 Jul 17 07:08:26 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Creating offline snapshot d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 of volume 7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f98d963-6f0c-4417-b92e-09489a90924f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7e1da857-88fb-474e-8344-db6b882eebd3 tempest-GroupSnapshotsV319Test-135498557 None] Group tempest-GroupSnapshotsV319Test-Group-1589102339: creating Jul 17 07:08:26 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.7d37858b-b165-4ec9-abdc-89c803720c07" returned: 0 in 0.400s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-7d37858b-b165-4ec9-abdc-89c803720c07" released by "_delete_snapshot" :: held 2.125s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7e1da857-88fb-474e-8344-db6b882eebd3 tempest-GroupSnapshotsV319Test-135498557 None] Group tempest-GroupSnapshotsV319Test-Group-1589102339: created successfully Jul 17 07:08:26 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 Jul 17 07:08:26 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" released by "delete_snapshot" :: held 2.170s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7e1da857-88fb-474e-8344-db6b882eebd3 tempest-GroupSnapshotsV319Test-135498557 None] Create group completed successfully. Jul 17 07:08:26 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Created reservations ['e4b7988d-6b6f-4ef6-96fb-cc88b02bf65b', '6ebb186e-0ab1-435f-bd84-9a684e97211d', 'f2903a0b-e6a5-409b-9343-d055ba16c887', '91ca0c52-b7f9-4693-9d13-b2073376f4c0'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:27 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Delete snapshot completed successfully. Jul 17 07:08:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f3093b4-43f7-452c-b3b7-f9cbc0069f7f tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-7d37858b-b165-4ec9-abdc-89c803720c07-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:27 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7" returned: 0 in 0.600s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:27 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 1G Jul 17 07:08:27 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:27 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 1G" returned: 0 in 0.502s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b947e1b-f684-4057-a802-4a49575ed7b7 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:27 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b947e1b-f684-4057-a802-4a49575ed7b7 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 Jul 17 07:08:27 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:28 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b947e1b-f684-4057-a802-4a49575ed7b7 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" returned: 0 in 0.517s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:28 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 is being set with open permissions: ugo+rw Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:28 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 Jul 17 07:08:28 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:28 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:28 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info Jul 17 07:08:28 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Flow 'volume_create_manager' (d820ea85-1368-417d-99af-1b877a9ac6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef346a2-4094-44aa-9121-be0baa112ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef346a2-4094-44aa-9121-be0baa112ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-296332430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fef59238-7379-40a5-95cc-3b6bbe229f77,host='devstack@QuobyteHD#QuobyteHD',id=0566baf2-7194-4215-91ca-7ba56006029a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d02e522303744d7a352b30dba2f8cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:29Z,use_quota=True,user_id='4f6b15fec2af4ea1a24602ad9ab4f3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc26619f-1ece-4941-809c-45105303f973),volume_type_id=dc26619f-1ece-4941-809c-45105303f973)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb12bac-6769-47fe-84a6-dcf1b48fe83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb12bac-6769-47fe-84a6-dcf1b48fe83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe45bca-eaa5-4d01-83ce-dd1113a42785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe45bca-eaa5-4d01-83ce-dd1113a42785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0566baf2-7194-4215-91ca-7ba56006029a', 'volume_name': 'volume-0566baf2-7194-4215-91ca-7ba56006029a', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbc594f-1aa5-46eb-8d34-c9fa34341e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbc594f-1aa5-46eb-8d34-c9fa34341e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5498ff21-a614-4e54-9b2a-c6faedc1c63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Volume 0566baf2-7194-4215-91ca-7ba56006029a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0566baf2-7194-4215-91ca-7ba56006029a', 'volume_size': 1} Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:28 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:28 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info is being set with open permissions: ugo+rw Jul 17 07:08:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:28 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info Jul 17 07:08:28 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:29 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.info" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.883s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Creating offline snapshot c3aefc15-6490-4e7e-908c-88d25fac89cd of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e8c288cd-ce20-44bf-b624-babd782b6e29 tempest-VolumesExtendTest-991137069 None] Create snapshot completed successfully Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e799e6-6231-4b62-b512-6d21f4d5b2aa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:29 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:29 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:29 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.396s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:29 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd 1G Jul 17 07:08:29 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:29 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:29 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:30 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.336s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:08:30 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd 1G" returned: 0 in 0.618s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:30 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd Jul 17 07:08:30 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:30 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd" returned: 0 in 0.349s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:30 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd is being set with open permissions: ugo+rw Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:30 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd Jul 17 07:08:30 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:30 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fef59238-7379-40a5-95cc-3b6bbe229f77,created_at=2026-07-17T05:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-296332430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fef59238-7379-40a5-95cc-3b6bbe229f77,host='devstack@QuobyteHD#QuobyteHD',id=0566baf2-7194-4215-91ca-7ba56006029a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d02e522303744d7a352b30dba2f8cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:29Z,use_quota=True,user_id='4f6b15fec2af4ea1a24602ad9ab4f3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc26619f-1ece-4941-809c-45105303f973),volume_type_id=dc26619f-1ece-4941-809c-45105303f973)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Creating volume 0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:30 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d3c46a39-d16d-4f8f-8efe-52d6ac8a97c3 tempest-SnapshotsActionsTest-423040830 None] Create snapshot completed successfully Jul 17 07:08:31 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a 1073741824 Jul 17 07:08:31 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (56ae900b-b0f0-4fc3-a06e-2540fafef9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fed2c91-45d6-459d-84fa-90deb2e08ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fed2c91-45d6-459d-84fa-90deb2e08ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1557941236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f2d92b-b608-4487-a319-10e02033fb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:31Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e4e7a5-f83f-4cd9-ac39-57d05fe859a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e4e7a5-f83f-4cd9-ac39-57d05fe859a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589fa7c0-cc0f-45ae-b317-f9e3ca98094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589fa7c0-cc0f-45ae-b317-f9e3ca98094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f2d92b-b608-4487-a319-10e02033fb81', 'volume_name': 'volume-b8f2d92b-b608-4487-a319-10e02033fb81', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d5d17-b70c-4307-b0e3-29aca1c92cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d5d17-b70c-4307-b0e3-29aca1c92cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319caf46-468a-4848-8fa1-a7fba0886bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:31 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Volume b8f2d92b-b608-4487-a319-10e02033fb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f2d92b-b608-4487-a319-10e02033fb81', 'volume_size': 1} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:31 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a 1073741824" returned: 0 in 0.510s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-c3aefc15-6490-4e7e-908c-88d25fac89cd-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:31 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a Jul 17 07:08:31 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-c3aefc15-6490-4e7e-908c-88d25fac89cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-c3aefc15-6490-4e7e-908c-88d25fac89cd" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-c3aefc15-6490-4e7e-908c-88d25fac89cd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Deleting offline snapshot c3aefc15-6490-4e7e-908c-88d25fac89cd of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] snapshot_file for this snap is: volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d289e83-3ef3-4f4e-a26f-b100217ac87c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:31 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd Jul 17 07:08:31 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:31 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a" returned: 0 in 0.257s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.029s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5498ff21-a614-4e54-9b2a-c6faedc1c63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0566baf2-7194-4215-91ca-7ba56006029a', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfef056-2089-4d09-a810-544faf7be60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f183c65-c729-4b17-8b8b-7be7058a8f76]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:31 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Volume volume-0566baf2-7194-4215-91ca-7ba56006029a (0566baf2-7194-4215-91ca-7ba56006029a): created successfully Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfef056-2089-4d09-a810-544faf7be60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Flow 'volume_create_manager' (d820ea85-1368-417d-99af-1b877a9ac6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a72f24de-e62f-4cdf-92b0-f0fcc721cc03 tempest-GroupSnapshotsV319Test-135498557 None] Created volume successfully. Jul 17 07:08:31 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 Jul 17 07:08:31 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:31 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd" returned: 0 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb0b1c-d425-48e9-881e-5b6c4899731d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:32 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:32 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:32 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7" returned: 0 in 0.415s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 2G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 2G" returned: 0 in 0.153s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.629s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1557941236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f2d92b-b608-4487-a319-10e02033fb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:31Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Creating volume b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:32 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:32 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] GroupSnapshot 7e6d3e7c-13ae-44d1-b498-dcee995fa5fa: creating. Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:32 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 1073741824 Jul 17 07:08:32 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:32 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd Jul 17 07:08:32 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Group snapshot 7e6d3e7c-13ae-44d1-b498-dcee995fa5fa: creating. {{(pid=87331) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-88a6fa9b-e6d1-44ef-908f-78161d6e567b tempest-VolumesExtendTest-991137069 None] Extend volume completed successfully. Jul 17 07:08:32 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd" returned: 0 in 0.431s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:32 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd Jul 17 07:08:32 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:32 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 1073741824" returned: 0 in 0.504s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:32 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 Jul 17 07:08:32 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-d3d2cd7b-80dd-4932-a97d-ae6bac1516b5-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Lock "cinder-d3d2cd7b-80dd-4932-a97d-ae6bac1516b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-quobyte-7b947e1b-f684-4057-a802-4a49575ed7b7" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-7b947e1b-f684-4057-a802-4a49575ed7b7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-quobyte-d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Deleting offline snapshot d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 of volume 7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:33 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] snapshot_file for this snap is: volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.c3aefc15-6490-4e7e-908c-88d25fac89cd" returned: 0 in 0.319s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7fb13-29f3-430a-8bb1-987057956630]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:33 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-c3aefc15-6490-4e7e-908c-88d25fac89cd" released by "_delete_snapshot" :: held 1.663s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.745s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" released by "delete_snapshot" :: held 1.705s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319caf46-468a-4848-8fa1-a7fba0886bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f2d92b-b608-4487-a319-10e02033fb81', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ea3795-3539-4ef1-9c7a-aae6db7f9986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Creating offline snapshot bd326d76-aec1-4ffd-82bb-bf9c3f8958ee of volume 0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:33 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Volume volume-b8f2d92b-b608-4487-a319-10e02033fb81 (b8f2d92b-b608-4487-a319-10e02033fb81): created successfully Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ea3795-3539-4ef1-9c7a-aae6db7f9986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (56ae900b-b0f0-4fc3-a06e-2540fafef9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[25434646-f568-49c7-abb5-80e830dbe2b3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:33 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 Jul 17 07:08:33 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-74e89d04-8a47-42cd-8bed-476a80a4b8ef tempest-VolumesSnapshotTestJSON-1039071146 None] Created volume successfully. Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Created reservations ['cbe43209-eace-4d1e-94b2-546196cfd565', '50182ba4-cb77-4f1b-b328-2f1f877594a7', '6f59adff-2fc7-42b8-bd2b-483792a72c7c', 'a52b8967-c28a-4865-9930-a09eaae630fe'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:33 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a Jul 17 07:08:33 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Delete snapshot completed successfully. Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e127bdc0-3f71-43e4-b741-e7aacef384c1 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-c3aefc15-6490-4e7e-908c-88d25fac89cd-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:33 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" returned: 0 in 0.381s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b947e1b-f684-4057-a802-4a49575ed7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe2a12a-4d92-4ad4-b3dc-40dccc039876]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:33 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a" returned: 0 in 0.390s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:33 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee 1G Jul 17 07:08:33 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:33 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 Jul 17 07:08:33 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:34 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7" returned: 0 in 0.406s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:34 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 Jul 17 07:08:34 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:34 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee 1G" returned: 0 in 0.466s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0566baf2-7194-4215-91ca-7ba56006029a -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:34 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0566baf2-7194-4215-91ca-7ba56006029a -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee Jul 17 07:08:34 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:34 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" returned: 0 in 0.426s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:34 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0566baf2-7194-4215-91ca-7ba56006029a -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:34 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:34 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5 Jul 17 07:08:34 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:34 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee Jul 17 07:08:34 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:34 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7.d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" returned: 0 in 0.271s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:34 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" returned: 0 in 0.286s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-d3d2cd7b-80dd-4932-a97d-ae6bac1516b5" released by "_delete_snapshot" :: held 1.609s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-7b947e1b-f684-4057-a802-4a49575ed7b7" released by "delete_snapshot" :: held 1.638s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:34 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info Jul 17 07:08:34 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Created reservations ['13553341-8469-4830-b508-6bebcba8d45c', '04c0c390-5993-42a5-9761-7b2512c4c2b2', '33d6f71c-9f1d-40ab-be63-c9804ad3d82d', '28664d26-bd19-4954-b3db-ba277012f650'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Delete snapshot completed successfully. Jul 17 07:08:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2f8e553a-13ae-4a1a-8773-db7fdd8739d6 tempest-VolumesExtendTest-991137069 None] Lock "cinder-d3d2cd7b-80dd-4932-a97d-ae6bac1516b5-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:35 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info" returned: 0 in 0.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:35 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:35 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info Jul 17 07:08:35 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:35 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.info" returned: 0 in 0.253s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.370s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-7b947e1b-f684-4057-a802-4a49575ed7b7-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Creating offline snapshot 762f3c45-6113-4f4e-9606-f716b853df70 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Lock "cinder-7b947e1b-f684-4057-a802-4a49575ed7b7-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[449727a3-c6c5-42dd-a689-b6841654cbc3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Acquiring lock "cinder-quobyte-7b947e1b-f684-4057-a802-4a49575ed7b7" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-7b947e1b-f684-4057-a802-4a49575ed7b7" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-54e0344c-c10e-4103-b83a-705969ce9725 tempest-GroupSnapshotsV319Test-135498557 None] group_snapshot 7e6d3e7c-13ae-44d1-b498-dcee995fa5fa: created successfully Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[39373804-d998-414d-9191-88ed0ae63130]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:35 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:35 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:35 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 Jul 17 07:08:35 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:35 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:35 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 1G Jul 17 07:08:35 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:35 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7" returned: 0 in 0.455s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:36 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7 Jul 17 07:08:36 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] group_snapshot 7e6d3e7c-13ae-44d1-b498-dcee995fa5fa: deleting Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] group_snapshot 7e6d3e7c-13ae-44d1-b498-dcee995fa5fa: deleting {{(pid=87331) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "cinder-quobyte-0566baf2-7194-4215-91ca-7ba56006029a" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Lock "cinder-quobyte-0566baf2-7194-4215-91ca-7ba56006029a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "cinder-quobyte-bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Lock "cinder-quobyte-bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Deleting offline snapshot bd326d76-aec1-4ffd-82bb-bf9c3f8958ee of volume 0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] snapshot_file for this snap is: volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc584a-0f66-41db-84c9-09935d6499a0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:36 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee Jul 17 07:08:36 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:36 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7b947e1b-f684-4057-a802-4a49575ed7b7" returned: 0 in 0.307s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Lock "cinder-quobyte-7b947e1b-f684-4057-a802-4a49575ed7b7" released by "delete_volume" :: held 0.823s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:36 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 1G" returned: 0 in 0.545s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Created reservations ['a08e5abe-46de-474c-bdca-8e9220bb30f8', '01bdc42f-bdc9-46cc-a7de-694cbe7be46b', 'd922f8ad-0000-448e-9e65-2582bdaa9c50', '0bc705cd-9095-41fb-88df-cb2385deb30b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:36 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 Jul 17 07:08:36 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:36 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:36 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:36 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" returned: 0 in 0.466s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0566baf2-7194-4215-91ca-7ba56006029a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4450e50f-0a93-47a9-ab72-d10c9326ec00]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:36 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70" returned: 0 in 0.355s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:36 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 is being set with open permissions: ugo+rw Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:36 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 Jul 17 07:08:36 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:36 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.307s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Deleted volume successfully. Jul 17 07:08:36 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a Jul 17 07:08:36 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7cd5cdeb-ac3a-401d-a1de-b4886824f63b tempest-VolumesExtendTest-991137069 None] Lock "cinder-7b947e1b-f684-4057-a802-4a49575ed7b7-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:37 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.706s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.334s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Creating offline snapshot ff38bf0b-70f9-468e-9945-5b4181dab5f7 of volume b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:37 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2831ed99-9e65-4712-8ee8-846110a0dedb tempest-SnapshotsActionsTest-423040830 None] Create snapshot completed successfully Jul 17 07:08:37 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96544f-54ad-46a0-8236-bc55edc2d5ff]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:37 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee Jul 17 07:08:37 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:37 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 Jul 17 07:08:37 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:37 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" returned: 0 in 0.416s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:37 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81" returned: 0 in 0.413s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:37 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee Jul 17 07:08:37 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:37 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 1G Jul 17 07:08:37 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:37 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a.bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" returned: 0 in 0.285s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Lock "cinder-quobyte-bd326d76-aec1-4ffd-82bb-bf9c3f8958ee" released by "_delete_snapshot" :: held 1.714s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Lock "cinder-quobyte-0566baf2-7194-4215-91ca-7ba56006029a" released by "delete_snapshot" :: held 1.747s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:37 devstack cinder-volume[87331]: WARNING cinder.quota [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-609781774 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-609781774, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:37 devstack cinder-volume[87331]: WARNING cinder.quota [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-609781774 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-609781774, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:37 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] Created reservations ['da9db7cf-f4c0-43c2-819e-d37489ecf683', '723da04b-89ed-44f1-b45e-fefe62931435', '77ff32f9-967b-40a4-8bc0-caed1e233877', '8810ad2b-80a0-4b3d-84f4-86d5a7204ae6'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:38 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-fdb3f9a0-2e88-4d76-8d17-6d203aebefa8 tempest-GroupSnapshotsV319Test-135498557 None] group_snapshot 7e6d3e7c-13ae-44d1-b498-dcee995fa5fa: deleted successfully Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 1G" returned: 0 in 0.506s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f2d92b-b608-4487-a319-10e02033fb81 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:38 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f2d92b-b608-4487-a319-10e02033fb81 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 Jul 17 07:08:38 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-762f3c45-6113-4f4e-9606-f716b853df70-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-762f3c45-6113-4f4e-9606-f716b853df70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Acquiring lock "cinder-quobyte-762f3c45-6113-4f4e-9606-f716b853df70" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-762f3c45-6113-4f4e-9606-f716b853df70" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Deleting offline snapshot 762f3c45-6113-4f4e-9606-f716b853df70 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] snapshot_file for this snap is: volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd08d5-c619-4b8b-a6b0-2eaec6021781]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:38 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f2d92b-b608-4487-a319-10e02033fb81 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7" returned: 0 in 0.369s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:38 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 is being set with open permissions: ugo+rw Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:38 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 Jul 17 07:08:38 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:38 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 Jul 17 07:08:38 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:38 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7" returned: 0 in 0.311s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "cinder-quobyte-0566baf2-7194-4215-91ca-7ba56006029a" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Lock "cinder-quobyte-0566baf2-7194-4215-91ca-7ba56006029a" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:38 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513e574-6733-47ea-a1c8-1447baf65be9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80c369-d4d4-48cf-b05e-2d00c94736fa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:38 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info Jul 17 07:08:38 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:38 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a Jul 17 07:08:38 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:39 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:39 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:39 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info" returned: 0 in 0.319s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:39 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info is being set with open permissions: ugo+rw Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:39 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info Jul 17 07:08:39 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:39 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:39 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 Jul 17 07:08:39 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:39 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a" returned: 0 in 0.549s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:39 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a Jul 17 07:08:39 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:39 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.info" returned: 0 in 0.278s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4a26fc2c-587f-41ff-8057-7e89bf5e4c4a tempest-VolumesSnapshotTestJSON-1039071146 None] Create snapshot completed successfully Jul 17 07:08:39 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0566baf2-7194-4215-91ca-7ba56006029a" returned: 0 in 0.303s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Lock "cinder-quobyte-0566baf2-7194-4215-91ca-7ba56006029a" released by "delete_volume" :: held 0.941s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Created reservations ['58236b2a-316e-4efa-8e5b-a727185c847c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:39 devstack cinder-volume[87331]: WARNING cinder.quota [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-609781774 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-609781774, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:08:39 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70" returned: 0 in 0.491s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Created reservations ['f4251e04-a397-4d19-bc04-9572a6bb018a', '22cc79f3-5bd7-4378-9869-e4f8ab408e8b', '82e9c582-09fb-4609-ab47-8aece5711bfc', '656fee03-96e9-4d25-ab7d-4d008cca8316'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:39 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70 Jul 17 07:08:39 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (78e8d214-275c-4509-9a6e-76426dcf6024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b5c2a5-7280-422e-ac27-9876e0a684b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b5c2a5-7280-422e-ac27-9876e0a684b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-387269162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c0675-8b33-41df-a850-9a3caf602d7e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:40Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac0657a-24ff-4d5b-b1e0-7eef4c8db4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac0657a-24ff-4d5b-b1e0-7eef4c8db4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc69da6-4c2c-4d19-8a5f-09b092f92258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc69da6-4c2c-4d19-8a5f-09b092f92258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1c0675-8b33-41df-a850-9a3caf602d7e', 'volume_name': 'volume-dc1c0675-8b33-41df-a850-9a3caf602d7e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e17054-a7b3-4890-8154-f3669b57e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e17054-a7b3-4890-8154-f3669b57e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e689dbc1-0589-4c5a-b25a-a6619c502634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Volume dc1c0675-8b33-41df-a850-9a3caf602d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1c0675-8b33-41df-a850-9a3caf602d7e', 'volume_size': 1} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-387269162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c0675-8b33-41df-a850-9a3caf602d7e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:40Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Creating volume dc1c0675-8b33-41df-a850-9a3caf602d7e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:40 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:40 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e 1073741824 Jul 17 07:08:40 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:40 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.762f3c45-6113-4f4e-9606-f716b853df70" returned: 0 in 0.321s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:40 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:40 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-762f3c45-6113-4f4e-9606-f716b853df70" released by "_delete_snapshot" :: held 1.844s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" released by "delete_snapshot" :: held 1.876s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-ff38bf0b-70f9-468e-9945-5b4181dab5f7-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-ff38bf0b-70f9-468e-9945-5b4181dab5f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-b8f2d92b-b608-4487-a319-10e02033fb81" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Created reservations ['8b8935f3-02da-4438-8014-feb3e9e96ed4', 'a7edfd3a-02df-418c-a713-ff26f3b4de72', 'c1f5bca0-e886-4906-bd1e-26c4bde64419', '15705cd4-2928-4bbf-961a-83f47419548a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-b8f2d92b-b608-4487-a319-10e02033fb81" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-ff38bf0b-70f9-468e-9945-5b4181dab5f7" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-ff38bf0b-70f9-468e-9945-5b4181dab5f7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Deleting offline snapshot ff38bf0b-70f9-468e-9945-5b4181dab5f7 of volume b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:40 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] snapshot_file for this snap is: volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.329s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d767ca7-9f54-474e-81b9-f8e3433d90d2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-50e127df-c2b7-4912-8cd1-bb231562714c tempest-GroupSnapshotsV319Test-135498557 None] Delete group completed successfully. Jul 17 07:08:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Delete snapshot completed successfully. Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7ab2ad11-6337-4ee3-b8e5-5c8103c2cfb5 tempest-SnapshotsActionsTest-279059186 None] Lock "cinder-762f3c45-6113-4f4e-9606-f716b853df70-delete_snapshot" released by "delete_snapshot" :: held 2.224s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:40 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 Jul 17 07:08:40 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:40 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e 1073741824" returned: 0 in 0.716s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:40 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e Jul 17 07:08:40 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:40 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7" returned: 0 in 0.490s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8f2d92b-b608-4487-a319-10e02033fb81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "cinder-d01b602c-ebd1-4811-94cd-aa72db1c6685-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adc0c79-e5c9-4f6b-940d-aba686bab68f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-d01b602c-ebd1-4811-94cd-aa72db1c6685-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "cinder-quobyte-d01b602c-ebd1-4811-94cd-aa72db1c6685" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-quobyte-d01b602c-ebd1-4811-94cd-aa72db1c6685" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Deleting offline snapshot d01b602c-ebd1-4811-94cd-aa72db1c6685 of volume e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] snapshot_file for this snap is: volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c18d3f-b9a9-471a-8872-49e9a2c44b13]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:41 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 Jul 17 07:08:41 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:41 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e689dbc1-0589-4c5a-b25a-a6619c502634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1c0675-8b33-41df-a850-9a3caf602d7e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42925c03-519f-44a5-b581-27767a10b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Volume volume-dc1c0675-8b33-41df-a850-9a3caf602d7e (dc1c0675-8b33-41df-a850-9a3caf602d7e): created successfully Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42925c03-519f-44a5-b581-27767a10b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (78e8d214-275c-4509-9a6e-76426dcf6024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dca30621-905b-47be-804c-6ea41aff7f32 tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:08:41 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:41 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:41 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:41 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 Jul 17 07:08:41 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:41 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.470s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ef2d2-bb5c-44ba-b788-c27067ca9896]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:41 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe Jul 17 07:08:41 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:41 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7" returned: 0 in 0.437s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:41 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7 Jul 17 07:08:41 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:42 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe" returned: 0 in 0.524s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:42 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81.ff38bf0b-70f9-468e-9945-5b4181dab5f7" returned: 0 in 0.342s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:42 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:42 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-ff38bf0b-70f9-468e-9945-5b4181dab5f7" released by "_delete_snapshot" :: held 1.894s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-b8f2d92b-b608-4487-a319-10e02033fb81" released by "delete_snapshot" :: held 1.932s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['fab1f14e-2b8c-4630-b2d5-0d3bc62c4aa1', '394bf85b-f489-403b-84b7-97706e7c1db5', '3b148a01-9fa3-40b2-89b7-ffd5b5f1408f', 'fdbc2c0d-0007-41f4-a071-608bbe63cee5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Delete snapshot completed successfully. Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4141b562-adcd-4d7f-aed2-3fe61b7c9c52 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-ff38bf0b-70f9-468e-9945-5b4181dab5f7-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:42 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.437s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:42 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685 Jul 17 07:08:42 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:42 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe.d01b602c-ebd1-4811-94cd-aa72db1c6685" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (09583fc7-4c02-4787-bc35-003711c36f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abd2714-a95b-497a-b403-b13e4e63dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-quobyte-d01b602c-ebd1-4811-94cd-aa72db1c6685" released by "_delete_snapshot" :: held 1.895s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" released by "delete_snapshot" :: held 1.930s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abd2714-a95b-497a-b403-b13e4e63dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-510542715',display_name='tempest-VolumesGetTest-Volume-2105865654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1856bece-48e8-4caa-a78a-0458713fbcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:43Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17083ac7-e1c8-4e9f-b055-42bd65be22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17083ac7-e1c8-4e9f-b055-42bd65be22ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dd1696-7826-42f8-998a-55ecdb7c2693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dd1696-7826-42f8-998a-55ecdb7c2693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1856bece-48e8-4caa-a78a-0458713fbcad', 'volume_name': 'volume-1856bece-48e8-4caa-a78a-0458713fbcad', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08830a6e-a8fb-4731-bfb7-d027f88f382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08830a6e-a8fb-4731-bfb7-d027f88f382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a586ba74-d9f8-4aad-8e19-deb2c0a7b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Volume 1856bece-48e8-4caa-a78a-0458713fbcad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1856bece-48e8-4caa-a78a-0458713fbcad', 'volume_size': 1} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-510542715',display_name='tempest-VolumesGetTest-Volume-2105865654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1856bece-48e8-4caa-a78a-0458713fbcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:43Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Creating volume 1856bece-48e8-4caa-a78a-0458713fbcad {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:43 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad 1073741824 Jul 17 07:08:43 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Created reservations ['f0275b68-f8d3-4c8a-bda2-36bb70ee18cf', '147f0f1f-8763-44fd-9700-8e9029391d7d', '95f015b9-438d-43dd-86b4-93b6696e5739', '2af5f4dd-52d7-4660-b123-83bc49fff947'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Delete snapshot completed successfully. Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d9395f2b-7e48-4344-a7c7-67bab591d97a tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-d01b602c-ebd1-4811-94cd-aa72db1c6685-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:43 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad 1073741824" returned: 0 in 0.531s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:43 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad Jul 17 07:08:43 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:43 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a586ba74-d9f8-4aad-8e19-deb2c0a7b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1856bece-48e8-4caa-a78a-0458713fbcad', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc18795-2e17-4cea-9215-b65bda8501ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Volume volume-1856bece-48e8-4caa-a78a-0458713fbcad (1856bece-48e8-4caa-a78a-0458713fbcad): created successfully Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc18795-2e17-4cea-9215-b65bda8501ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (09583fc7-4c02-4787-bc35-003711c36f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9348c71c-388e-44a1-942d-5cebb32a3dcf tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (50cab0e0-a3fa-476a-afc4-63f94e1df76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961ed5da-8044-43d8-a6bd-2d8329d590f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961ed5da-8044-43d8-a6bd-2d8329d590f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-580992906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfad752a-19e3-42f8-b39d-a6690597d04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:44Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c74fd1-4b3c-4086-9da3-285b1016d3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c74fd1-4b3c-4086-9da3-285b1016d3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d70cfb-9088-4ced-8250-1680be2c03a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d70cfb-9088-4ced-8250-1680be2c03a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfad752a-19e3-42f8-b39d-a6690597d04d', 'volume_name': 'volume-cfad752a-19e3-42f8-b39d-a6690597d04d', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2de1e6-c0d5-4963-814d-dea7843857c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2de1e6-c0d5-4963-814d-dea7843857c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01370716-f2cc-4ff6-8dad-5f2645ea358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Volume cfad752a-19e3-42f8-b39d-a6690597d04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfad752a-19e3-42f8-b39d-a6690597d04d', 'volume_size': 1} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-580992906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfad752a-19e3-42f8-b39d-a6690597d04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:44Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Creating volume cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:44 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d 1073741824 Jul 17 07:08:44 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "cinder-e2184367-0568-4b12-8f81-7a5f3bfe68fe-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-e2184367-0568-4b12-8f81-7a5f3bfe68fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cf9ab7-f265-4538-b457-be77d3e8f3e9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:44 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe Jul 17 07:08:44 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:44 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d 1073741824" returned: 0 in 0.479s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:44 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:08:44 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:44 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe" returned: 0 in 0.402s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:44 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe Jul 17 07:08:44 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:45 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 0.325s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01370716-f2cc-4ff6-8dad-5f2645ea358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfad752a-19e3-42f8-b39d-a6690597d04d', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc827e1c-293b-4c02-9e2b-d4b7a6ad6848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Volume volume-cfad752a-19e3-42f8-b39d-a6690597d04d (cfad752a-19e3-42f8-b39d-a6690597d04d): created successfully Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc827e1c-293b-4c02-9e2b-d4b7a6ad6848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (50cab0e0-a3fa-476a-afc4-63f94e1df76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:45 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e2184367-0568-4b12-8f81-7a5f3bfe68fe" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1c2bbb03-d49e-402f-8b1a-abd3572a53d6 tempest-VolumesSnapshotTestJSON-1039071146 None] Created volume successfully. Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-quobyte-e2184367-0568-4b12-8f81-7a5f3bfe68fe" released by "delete_volume" :: held 0.798s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-1856bece-48e8-4caa-a78a-0458713fbcad-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Lock "cinder-1856bece-48e8-4caa-a78a-0458713fbcad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Created reservations ['c15f48a3-dc3f-4a59-8e35-be755e42bcb8', 'bf595ea5-e30a-4882-8dfd-86a6743b6fa1', '1e83f2bc-926d-4c19-8089-a523dce5b754', '4b4e0135-58fb-4feb-96c6-7c6d1a7c8b4b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-1856bece-48e8-4caa-a78a-0458713fbcad" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-1856bece-48e8-4caa-a78a-0458713fbcad" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbb3af-dd37-428e-ac29-6763ab67003a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:45 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:45 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:45 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad Jul 17 07:08:45 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:45 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.304s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Deleted volume successfully. Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e8f71d1d-f8c3-4683-8962-527a4e7d54b6 tempest-SnapshotsActionsTest-423040830 None] Lock "cinder-e2184367-0568-4b12-8f81-7a5f3bfe68fe-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:45 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad" returned: 0 in 0.420s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:45 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad Jul 17 07:08:45 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:46 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1856bece-48e8-4caa-a78a-0458713fbcad" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-1856bece-48e8-4caa-a78a-0458713fbcad" released by "delete_volume" :: held 0.736s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Created reservations ['6012e034-da1a-4bc0-9894-4e66d1d61fbe', 'e0a3af6f-86d2-41f7-ab3a-0dc30695a69e', '42a2d410-bc24-4160-87a9-453cd1c89a11', 'd949d657-eab5-4841-970e-4e22b5470e0d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:46 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:46 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-dc1c0675-8b33-41df-a850-9a3caf602d7e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:46 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Creating offline snapshot c9fdc711-d512-4907-b26b-04b157f4a83d of volume cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Lock "cinder-dc1c0675-8b33-41df-a850-9a3caf602d7e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[891b0bd3-feba-4c1c-ad47-dd01478c99fb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:46 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-dc1c0675-8b33-41df-a850-9a3caf602d7e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a35e61d2-4954-47d9-a5f7-14dd9f1fdd98 tempest-VolumesGetTest-1465116479 None] Lock "cinder-1856bece-48e8-4caa-a78a-0458713fbcad-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-dc1c0675-8b33-41df-a850-9a3caf602d7e" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c8be6-5caa-4b5d-8d6b-d987d1620798]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:46 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:08:46 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:46 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e Jul 17 07:08:46 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:47 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 0.406s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:47 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d 1G Jul 17 07:08:47 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:47 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e" returned: 0 in 0.398s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:47 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e Jul 17 07:08:47 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:47 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dc1c0675-8b33-41df-a850-9a3caf602d7e" returned: 0 in 0.339s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-dc1c0675-8b33-41df-a850-9a3caf602d7e" released by "delete_volume" :: held 0.792s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Created reservations ['9367ed4f-3b42-40af-92ea-da11a23069d9', '4ba1e7f9-b4ac-4c9a-a870-a5a4e9ceb7fc', '428c0448-0687-482c-a47f-3d5e861f8f56', '76a98750-b730-413a-a0d4-7a66f3b504cb'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:08:47 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d 1G" returned: 0 in 0.612s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfad752a-19e3-42f8-b39d-a6690597d04d -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:47 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfad752a-19e3-42f8-b39d-a6690597d04d -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d Jul 17 07:08:47 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:47 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:08:47 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:48 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.395s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:08:48 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-7f099cdb-ed33-40b4-b55f-4dab089e00ba tempest-VolumesGetTest-1465116479 None] Lock "cinder-dc1c0675-8b33-41df-a850-9a3caf602d7e-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:48 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfad752a-19e3-42f8-b39d-a6690597d04d -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d" returned: 0 in 0.593s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:48 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d is being set with open permissions: ugo+rw Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:48 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d Jul 17 07:08:48 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:48 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d" returned: 0 in 0.311s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:48 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info Jul 17 07:08:48 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:48 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:48 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info is being set with open permissions: ugo+rw Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:48 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info Jul 17 07:08:48 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (44771635-d8d3-418f-b6ed-d935ad6c8bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d43bbd-17a8-4307-9f6f-7e892c2dbc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d43bbd-17a8-4307-9f6f-7e892c2dbc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-851859900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db825d13-fd29-4e4d-9523-8b5faa37fd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:49Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4ffbb2-43e8-4a42-b530-5983ee41d012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4ffbb2-43e8-4a42-b530-5983ee41d012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bae656-b98a-4efe-9a56-b89eeef31314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bae656-b98a-4efe-9a56-b89eeef31314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db825d13-fd29-4e4d-9523-8b5faa37fd64', 'volume_name': 'volume-db825d13-fd29-4e4d-9523-8b5faa37fd64', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7ef080-6519-4deb-9f1a-568658b3bd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7ef080-6519-4deb-9f1a-568658b3bd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0358b74-d5fc-4279-9bd5-f2090ff0fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Volume db825d13-fd29-4e4d-9523-8b5faa37fd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db825d13-fd29-4e4d-9523-8b5faa37fd64', 'volume_size': 1} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:49 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.info" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-851859900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db825d13-fd29-4e4d-9523-8b5faa37fd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:49Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Creating volume db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:49 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:49 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 1073741824 Jul 17 07:08:49 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4752e43e-25e9-45cd-970a-6e24e7218693 tempest-VolumesSnapshotTestJSON-1039071146 None] Create snapshot completed successfully Jul 17 07:08:49 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 1073741824" returned: 0 in 0.518s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:49 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:08:49 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:50 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0358b74-d5fc-4279-9bd5-f2090ff0fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db825d13-fd29-4e4d-9523-8b5faa37fd64', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0f8b5d-2932-48a1-ae27-45af516b3510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:50 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Volume volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 (db825d13-fd29-4e4d-9523-8b5faa37fd64): created successfully Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0f8b5d-2932-48a1-ae27-45af516b3510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (44771635-d8d3-418f-b6ed-d935ad6c8bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:50 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f51ae8f6-abd8-4605-8423-600156c12ba6 tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (809e60dc-4be7-44b1-89b1-28085411bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a617c9e-2a26-4af4-b120-218d6a1b326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a617c9e-2a26-4af4-b120-218d6a1b326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1773264633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbff5e08-6dd0-475d-b2f7-78eef17055f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c9fdc711-d512-4907-b26b-04b157f4a83d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:50Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5a3d6d-1e32-4aec-98f2-ec4fe9d1b199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5a3d6d-1e32-4aec-98f2-ec4fe9d1b199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed6b832-79a7-4528-b3c0-3ed83cf4161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed6b832-79a7-4528-b3c0-3ed83cf4161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dbff5e08-6dd0-475d-b2f7-78eef17055f4', 'volume_name': 'volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4', 'volume_size': 2, 'snapshot_id': 'c9fdc711-d512-4907-b26b-04b157f4a83d'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69d9727-89c0-4166-9394-d9b93df2c88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69d9727-89c0-4166-9394-d9b93df2c88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bee03f2-7e0e-469c-9d89-082719fd567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:50 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Volume dbff5e08-6dd0-475d-b2f7-78eef17055f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4', 'volume_size': 2, 'snapshot_id': 'c9fdc711-d512-4907-b26b-04b157f4a83d'} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-c9fdc711-d512-4907-b26b-04b157f4a83d-dbff5e08-6dd0-475d-b2f7-78eef17055f4" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-c9fdc711-d512-4907-b26b-04b157f4a83d-dbff5e08-6dd0-475d-b2f7-78eef17055f4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Creating volume dbff5e08-6dd0-475d-b2f7-78eef17055f4 from snapshot c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-dbff5e08-6dd0-475d-b2f7-78eef17055f4" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-dbff5e08-6dd0-475d-b2f7-78eef17055f4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] snapshot: c9fdc711-d512-4907-b26b-04b157f4a83d, volume: dbff5e08-6dd0-475d-b2f7-78eef17055f4, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ac90a-9251-4d8c-bc9f-3a59cb5a3ce5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:50 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d Jul 17 07:08:50 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:51 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d" returned: 0 in 0.476s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfad752a-19e3-42f8-b39d-a6690597d04d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ba180-a1ed-482f-8680-fb0371d9d222]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:51 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:08:51 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (5a435546-2c3d-4999-944e-1da8d1584541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947fb702-f4f1-49fe-b543-e2d61ef13e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947fb702-f4f1-49fe-b543-e2d61ef13e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-994893604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1074cf46-fb46-4b41-8560-12418fb0bf01,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=db825d13-fd29-4e4d-9523-8b5faa37fd64,status='creating',terminated_at=None,updated_at=2026-07-17T05:08:51Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915cb36e-fad1-455c-9713-ab0dc577a679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915cb36e-fad1-455c-9713-ab0dc577a679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc8fe57-e692-4c44-86ee-427f9d27f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc8fe57-e692-4c44-86ee-427f9d27f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1074cf46-fb46-4b41-8560-12418fb0bf01', 'volume_name': 'volume-1074cf46-fb46-4b41-8560-12418fb0bf01', 'volume_size': 1, 'source_volid': 'db825d13-fd29-4e4d-9523-8b5faa37fd64', 'source_volstatus': 'available'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0069041-5bee-4ea7-80f0-0b7658e0a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0069041-5bee-4ea7-80f0-0b7658e0a183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d7d2f7-a07b-4ae0-a68a-30646c24fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:51 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Volume 1074cf46-fb46-4b41-8560-12418fb0bf01: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1074cf46-fb46-4b41-8560-12418fb0bf01', 'volume_size': 1, 'source_volid': 'db825d13-fd29-4e4d-9523-8b5faa37fd64', 'source_volstatus': 'available'} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:08:51 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 0.541s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:08:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:51 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 Jul 17 07:08:51 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:57 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4" returned: 0 in 5.738s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a3e7c5-6f43-47cf-b340-e1e3eba3c21b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:57 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:08:57 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:57 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 0.600s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:57 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:08:57 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Converted 1024.00 MB image at 178.43 MB/s Jul 17 07:08:57 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 is being set with open permissions: ugo+rw Jul 17 07:08:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:58 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 Jul 17 07:08:58 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:58 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4" returned: 0 in 0.299s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-dbff5e08-6dd0-475d-b2f7-78eef17055f4" released by "_copy_volume_from_snapshot" :: held 7.782s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-c9fdc711-d512-4907-b26b-04b157f4a83d-dbff5e08-6dd0-475d-b2f7-78eef17055f4" released by "_create_volume_from_snapshot" :: held 7.820s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.837s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.862s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:08:58 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Cloning volume db825d13-fd29-4e4d-9523-8b5faa37fd64 to volume 1074cf46-fb46-4b41-8560-12418fb0bf01 Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Creating offline snapshot 25a859e6-69fe-40b6-9093-665fc9cdddbe of volume db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bee03f2-7e0e-469c-9d89-082719fd567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4', 'volume_size': 2, 'snapshot_id': 'c9fdc711-d512-4907-b26b-04b157f4a83d'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4781eac1-fcbf-4b83-8f2d-4786c90b1896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d1caac-cfa1-4a24-8f91-6ff017ec305f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:58 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Volume volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 (dbff5e08-6dd0-475d-b2f7-78eef17055f4): created successfully Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4781eac1-fcbf-4b83-8f2d-4786c90b1896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (809e60dc-4be7-44b1-89b1-28085411bddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:08:58 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c719f71a-0259-4e9b-b5df-ec54a98bb315 tempest-VolumesSnapshotTestJSON-1039071146 None] Created volume successfully. Jul 17 07:08:58 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:08:58 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:58 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.415s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:58 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe 1G Jul 17 07:08:58 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:59 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe 1G" returned: 0 in 0.547s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-dbff5e08-6dd0-475d-b2f7-78eef17055f4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:59 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe Jul 17 07:08:59 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-dbff5e08-6dd0-475d-b2f7-78eef17055f4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-dbff5e08-6dd0-475d-b2f7-78eef17055f4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-dbff5e08-6dd0-475d-b2f7-78eef17055f4" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e5b0b-7fe3-4188-ba39-6ccda119575e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:59 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 Jul 17 07:08:59 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:08:59 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe" returned: 0 in 0.358s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:08:59 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe is being set with open permissions: ugo+rw Jul 17 07:08:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:08:59 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe Jul 17 07:08:59 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:00 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4" returned: 0 in 0.460s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:00 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:00 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4 Jul 17 07:09:00 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe" returned: 0 in 0.334s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:00 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info Jul 17 07:09:00 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:00 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dbff5e08-6dd0-475d-b2f7-78eef17055f4" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-dbff5e08-6dd0-475d-b2f7-78eef17055f4" released by "delete_volume" :: held 0.858s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:00 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info" returned: 0 in 0.319s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:00 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info is being set with open permissions: ugo+rw Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['2df80bb0-223b-493f-942f-046943ee8339', '3a7333a6-a335-4229-b83e-543ed516b259', 'b3de6e16-5ed5-4a53-b3b1-1f22489b7955', '61fa181d-8558-45e6-b49e-ef1a41dd035b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:00 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info Jul 17 07:09:00 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:00 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:00 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-c9fdc711-d512-4907-b26b-04b157f4a83d-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-c9fdc711-d512-4907-b26b-04b157f4a83d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-cfad752a-19e3-42f8-b39d-a6690597d04d" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cfad752a-19e3-42f8-b39d-a6690597d04d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-c9fdc711-d512-4907-b26b-04b157f4a83d" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-c9fdc711-d512-4907-b26b-04b157f4a83d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Deleting offline snapshot c9fdc711-d512-4907-b26b-04b157f4a83d of volume cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:09:00 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] snapshot_file for this snap is: volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.info" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-1074cf46-fb46-4b41-8560-12418fb0bf01" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b8a8c-ec65-4dfe-9a8f-2122d3cb1513]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-1074cf46-fb46-4b41-8560-12418fb0bf01" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] snapshot: 25a859e6-69fe-40b6-9093-665fc9cdddbe, volume: 1074cf46-fb46-4b41-8560-12418fb0bf01, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b4c2b-b45d-480d-a0e2-517333eccdc8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:00 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.389s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:00 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:01 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Deleted volume successfully. Jul 17 07:09:01 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d Jul 17 07:09:01 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c0272efe-dedd-41d0-9455-e1dab9a77cd1 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-dbff5e08-6dd0-475d-b2f7-78eef17055f4-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:01 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe Jul 17 07:09:01 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:01 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d" returned: 0 in 0.561s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfad752a-19e3-42f8-b39d-a6690597d04d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bef470-27a8-49f0-b72c-43c5cc56da09]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:01 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe" returned: 0 in 0.514s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db825d13-fd29-4e4d-9523-8b5faa37fd64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1313e-4bba-4e9e-bfc9-4df91ba281f8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:01 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:09:01 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:01 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:09:01 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:01 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.480s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:01 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 0.556s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:01 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:01 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:02 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d Jul 17 07:09:02 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:02 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:02 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d Jul 17 07:09:02 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:02 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d.c9fdc711-d512-4907-b26b-04b157f4a83d" returned: 0 in 0.627s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:03 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=246,cinder:SELECT=244,cinder:INSERT=63,cinder:DELETE=14 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:09:03 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=212,cinder:INSERT=75,cinder:UPDATE=257,cinder:DELETE=19 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:09:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-c9fdc711-d512-4907-b26b-04b157f4a83d" released by "_delete_snapshot" :: held 2.360s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cfad752a-19e3-42f8-b39d-a6690597d04d" released by "delete_snapshot" :: held 2.420s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:03 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['c1e19898-5382-459b-8fc6-3716351d7883', '261fd7e2-532c-43f1-b30c-cf51d2e4a5fb', '3d8b74ac-60b2-4c27-9929-dfc4a159999a', 'dd86f647-96e9-4a6c-a2e5-8cc33e02efcf'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:03 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Delete snapshot completed successfully. Jul 17 07:09:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4fc0fc45-86c6-4d9a-8dfb-c7d1eb5ca13b tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-c9fdc711-d512-4907-b26b-04b157f4a83d-delete_snapshot" released by "delete_snapshot" :: held 2.767s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-cfad752a-19e3-42f8-b39d-a6690597d04d-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-cfad752a-19e3-42f8-b39d-a6690597d04d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-cfad752a-19e3-42f8-b39d-a6690597d04d" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cfad752a-19e3-42f8-b39d-a6690597d04d" acquired by "delete_volume" :: waited 0.054s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:04 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fed5d50-a09d-480f-9a1c-e338ae30f84f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:05 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:09:05 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:05 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 1.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:06 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d Jul 17 07:09:06 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:06 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-cfad752a-19e3-42f8-b39d-a6690597d04d" returned: 0 in 0.909s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cfad752a-19e3-42f8-b39d-a6690597d04d" released by "delete_volume" :: held 2.348s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['ebfc71f3-35eb-451d-be3b-c12e8308b736', 'a57515ba-1cf6-4c1e-b862-7e8a95e92124', '404bf7b0-cc56-43f4-9824-3bc66a9474d1', 'b47d950f-7445-4edb-b6cd-a7e87c46c561'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:07 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:07 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:07 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01" returned: 0 in 5.943s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:07 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.672s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c04bc06-f25e-46f8-9854-6c43367aa303]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Deleted volume successfully. Jul 17 07:09:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5a31629-7b26-403b-801d-7c3e41692643 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-cfad752a-19e3-42f8-b39d-a6690597d04d-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:08 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:09:08 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:08 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.674s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:09:08 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Converted 1024.00 MB image at 172.22 MB/s Jul 17 07:09:08 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 is being set with open permissions: ugo+rw Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:08 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 Jul 17 07:09:08 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (f39222fb-f1c1-4810-8e0b-521a13ba2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e81009b-5d39-4ecf-a08a-58857eaf024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e81009b-5d39-4ecf-a08a-58857eaf024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1604282042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85358893-f865-4410-ab08-d5c7b88fe571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:09Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3588276-d47d-412f-8790-900d9fcc36f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3588276-d47d-412f-8790-900d9fcc36f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b7182e-524a-41ac-99c7-50971d98755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b7182e-524a-41ac-99c7-50971d98755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85358893-f865-4410-ab08-d5c7b88fe571', 'volume_name': 'volume-85358893-f865-4410-ab08-d5c7b88fe571', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1610e7d-928a-46ee-acd3-90a1372ab1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1610e7d-928a-46ee-acd3-90a1372ab1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c246e75-0b5f-4f5c-82b5-e8f047077738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Volume 85358893-f865-4410-ab08-d5c7b88fe571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85358893-f865-4410-ab08-d5c7b88fe571', 'volume_size': 1} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:08 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-1074cf46-fb46-4b41-8560-12418fb0bf01" released by "_copy_volume_from_snapshot" :: held 8.016s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-25a859e6-69fe-40b6-9093-665fc9cdddbe" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-25a859e6-69fe-40b6-9093-665fc9cdddbe" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Deleting offline snapshot 25a859e6-69fe-40b6-9093-665fc9cdddbe of volume db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] snapshot_file for this snap is: volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba6c0c-032d-4ad5-a843-0f6a286df6d0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:09 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe Jul 17 07:09:09 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:09 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe" returned: 0 in 0.396s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db825d13-fd29-4e4d-9523-8b5faa37fd64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:09 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd2987-2f35-41ca-aa6c-78d9328bb4f1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:09 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:09:09 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:09 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:09 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe Jul 17 07:09:09 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:10 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe" returned: 0 in 0.394s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:10 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe Jul 17 07:09:10 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:10 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64.25a859e6-69fe-40b6-9093-665fc9cdddbe" returned: 0 in 0.268s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-25a859e6-69fe-40b6-9093-665fc9cdddbe" released by "_delete_snapshot" :: held 1.592s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.241s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.800s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1604282042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85358893-f865-4410-ab08-d5c7b88fe571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:09Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Creating volume 85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:10 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d7d2f7-a07b-4ae0-a68a-30646c24fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1074cf46-fb46-4b41-8560-12418fb0bf01', 'volume_size': 1, 'source_volid': 'db825d13-fd29-4e4d-9523-8b5faa37fd64', 'source_volstatus': 'available'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:10 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 1073741824 Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500fa4de-394f-43f5-840a-c151267ce607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:10 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Volume volume-1074cf46-fb46-4b41-8560-12418fb0bf01 (1074cf46-fb46-4b41-8560-12418fb0bf01): created successfully Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500fa4de-394f-43f5-840a-c151267ce607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (5a435546-2c3d-4999-944e-1da8d1584541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-5b09edee-a903-44c9-932f-bb4df11835d2 tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:09:11 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 1073741824" returned: 0 in 0.596s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:11 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:11 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:11 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.339s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c246e75-0b5f-4f5c-82b5-e8f047077738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85358893-f865-4410-ab08-d5c7b88fe571', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289435ad-13ae-4446-a861-817b09fb82df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:11 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Volume volume-85358893-f865-4410-ab08-d5c7b88fe571 (85358893-f865-4410-ab08-d5c7b88fe571): created successfully Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289435ad-13ae-4446-a861-817b09fb82df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (f39222fb-f1c1-4810-8e0b-521a13ba2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d66884d4-32de-4bc2-81bc-3577ebab2b6c tempest-VolumesSnapshotTestJSON-1039071146 None] Created volume successfully. Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Creating offline snapshot cf8202cd-895d-4317-8a70-1ce5c85a9946 of volume 85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b834f-0784-498c-bc99-f2853540b58c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:12 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:12 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (e7fc880f-6f1c-4aac-a959-c784ee4ae0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d271f2d6-7280-4898-9010-0f428ee18be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d271f2d6-7280-4898-9010-0f428ee18be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-560056129',display_name='tempest-VolumesGetTest-Volume-318099725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d0146e-0e0e-48a8-99cc-26f26062abfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:12Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07f263d-2be3-44e3-8f68-2967be6eb2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07f263d-2be3-44e3-8f68-2967be6eb2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c05e47-47ec-4cbc-9204-f011e04f879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c05e47-47ec-4cbc-9204-f011e04f879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d0146e-0e0e-48a8-99cc-26f26062abfa', 'volume_name': 'volume-38d0146e-0e0e-48a8-99cc-26f26062abfa', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc49edc0-f48b-4122-979c-8e656d0c59ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc49edc0-f48b-4122-979c-8e656d0c59ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5261ec0-b916-4ce9-95d9-3ff95b032fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:12 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Volume 38d0146e-0e0e-48a8-99cc-26f26062abfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d0146e-0e0e-48a8-99cc-26f26062abfa', 'volume_size': 1} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:12 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.535s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:12 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 1G Jul 17 07:09:12 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:13 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 1G" returned: 0 in 0.542s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85358893-f865-4410-ab08-d5c7b88fe571 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:13 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85358893-f865-4410-ab08-d5c7b88fe571 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 Jul 17 07:09:13 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:13 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85358893-f865-4410-ab08-d5c7b88fe571 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946" returned: 0 in 0.367s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:13 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 is being set with open permissions: ugo+rw Jul 17 07:09:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:13 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 Jul 17 07:09:13 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:13 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:13 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info Jul 17 07:09:13 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:14 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info" returned: 0 in 0.342s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:14 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info is being set with open permissions: ugo+rw Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:14 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info Jul 17 07:09:14 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:14 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.info" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-560056129',display_name='tempest-VolumesGetTest-Volume-318099725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d0146e-0e0e-48a8-99cc-26f26062abfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:12Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Creating volume 38d0146e-0e0e-48a8-99cc-26f26062abfa {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:14 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:14 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa 1073741824 Jul 17 07:09:14 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2578f421-e342-4d4d-ac9f-e7ca83fb7326 tempest-VolumesSnapshotTestJSON-1039071146 None] Create snapshot completed successfully Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Flow 'volume_create_manager' (486c3de1-e4a5-4676-8fd5-0dbc3f07b56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0db0cc-ba71-4bb0-be3b-5ac54edeb1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0db0cc-ba71-4bb0-be3b-5ac54edeb1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-644631501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ac7b2e-62e6-4570-adb8-6990ccb42d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c9fb337fcd473d9bcf80ea5190c4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:15Z,use_quota=True,user_id='988bef5035ce4f14a51bf6b51c354e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(687c14ca-c288-47c4-93ca-53b91f75030b),volume_type_id=687c14ca-c288-47c4-93ca-53b91f75030b)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93aef990-9109-4838-b68e-ba50252b29a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93aef990-9109-4838-b68e-ba50252b29a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc6eb36-5806-44bd-9bec-4ffb045be0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc6eb36-5806-44bd-9bec-4ffb045be0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ac7b2e-62e6-4570-adb8-6990ccb42d53', 'volume_name': 'volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff7f5db-66d4-4058-bbe5-6002110b3a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff7f5db-66d4-4058-bbe5-6002110b3a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff675fd2-6287-4c9d-a6f2-77fe99361da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:14 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Volume 20ac7b2e-62e6-4570-adb8-6990ccb42d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53', 'volume_size': 1} Jul 17 07:09:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:15 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa 1073741824" returned: 0 in 0.498s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:15 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa Jul 17 07:09:15 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:15 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa" returned: 0 in 0.288s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-644631501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ac7b2e-62e6-4570-adb8-6990ccb42d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c9fb337fcd473d9bcf80ea5190c4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:15Z,use_quota=True,user_id='988bef5035ce4f14a51bf6b51c354e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(687c14ca-c288-47c4-93ca-53b91f75030b),volume_type_id=687c14ca-c288-47c4-93ca-53b91f75030b)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Creating volume 20ac7b2e-62e6-4570-adb8-6990ccb42d53 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:15 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:15 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 1073741824 Jul 17 07:09:15 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5261ec0-b916-4ce9-95d9-3ff95b032fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d0146e-0e0e-48a8-99cc-26f26062abfa', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086aa435-417f-4e8f-8a47-1209f4b60a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Volume volume-38d0146e-0e0e-48a8-99cc-26f26062abfa (38d0146e-0e0e-48a8-99cc-26f26062abfa): created successfully Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086aa435-417f-4e8f-8a47-1209f4b60a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (e7fc880f-6f1c-4aac-a959-c784ee4ae0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:15 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70f0ee37-455c-47cf-bf39-b44a4064b1fa tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-38d0146e-0e0e-48a8-99cc-26f26062abfa-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Lock "cinder-38d0146e-0e0e-48a8-99cc-26f26062abfa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (4e6dd1a7-855a-47eb-83e8-01b51007ff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63776a4c-68d0-4fdc-afc4-686ab4e1a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63776a4c-68d0-4fdc-afc4-686ab4e1a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-9715643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70021251-cc9d-4c87-89c1-ce8bd7c54425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80c5db16504e158d506a43ae55f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf8202cd-895d-4317-8a70-1ce5c85a9946,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:16Z,use_quota=True,user_id='b43cb3b4775443eca172efaeae004fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d91c1c-36e8-492e-a4c3-10664227f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d91c1c-36e8-492e-a4c3-10664227f483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635e89e8-44e7-4456-867c-5818f3675aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:16 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635e89e8-44e7-4456-867c-5818f3675aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70021251-cc9d-4c87-89c1-ce8bd7c54425', 'volume_name': 'volume-70021251-cc9d-4c87-89c1-ce8bd7c54425', 'volume_size': 1, 'snapshot_id': 'cf8202cd-895d-4317-8a70-1ce5c85a9946'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd56454-3010-4efa-9a9c-482d704fc125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd56454-3010-4efa-9a9c-482d704fc125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38d1c13-7b00-431f-baad-6c0d5ed20b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Volume 70021251-cc9d-4c87-89c1-ce8bd7c54425: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70021251-cc9d-4c87-89c1-ce8bd7c54425', 'volume_size': 1, 'snapshot_id': 'cf8202cd-895d-4317-8a70-1ce5c85a9946'} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 1073741824" returned: 0 in 0.690s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-38d0146e-0e0e-48a8-99cc-26f26062abfa" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-38d0146e-0e0e-48a8-99cc-26f26062abfa" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c54e5e7-6c38-473b-b0ab-8526b1479361]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:16 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 Jul 17 07:09:16 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:16 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa Jul 17 07:09:16 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:16 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.306s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-cf8202cd-895d-4317-8a70-1ce5c85a9946-70021251-cc9d-4c87-89c1-ce8bd7c54425" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff675fd2-6287-4c9d-a6f2-77fe99361da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a181226d-d318-4bcf-bfe9-9197128b57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Volume volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 (20ac7b2e-62e6-4570-adb8-6990ccb42d53): created successfully Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a181226d-d318-4bcf-bfe9-9197128b57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Flow 'volume_create_manager' (486c3de1-e4a5-4676-8fd5-0dbc3f07b56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cf8202cd-895d-4317-8a70-1ce5c85a9946-70021251-cc9d-4c87-89c1-ce8bd7c54425" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Creating volume 70021251-cc9d-4c87-89c1-ce8bd7c54425 from snapshot cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-70021251-cc9d-4c87-89c1-ce8bd7c54425" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8a8ca415-215a-4cf0-a838-aa7ddb24a647 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Created volume successfully. Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-70021251-cc9d-4c87-89c1-ce8bd7c54425" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] snapshot: cf8202cd-895d-4317-8a70-1ce5c85a9946, volume: 70021251-cc9d-4c87-89c1-ce8bd7c54425, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c913b0-f8c1-4962-a416-9cf49838325a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:16 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:16 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa Jul 17 07:09:16 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:16 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 Jul 17 07:09:16 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:16 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-38d0146e-0e0e-48a8-99cc-26f26062abfa" returned: 0 in 0.288s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-38d0146e-0e0e-48a8-99cc-26f26062abfa" released by "delete_volume" :: held 0.770s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:16 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Created reservations ['d0e0b821-312e-4108-8d90-735f6b427608', '7ee8447a-d1d0-4b86-870c-018b747a2207', '523d1039-a0ca-43cf-aa4a-402d20155c78', '4a493a08-f2bc-4078-898f-a0bbc9b8bee5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:17 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946" returned: 0 in 0.524s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85358893-f865-4410-ab08-d5c7b88fe571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb9a913-daad-4dca-a323-74ece50a8794]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:17 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:17 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:17 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:17 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-1074cf46-fb46-4b41-8560-12418fb0bf01-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Lock "cinder-1074cf46-fb46-4b41-8560-12418fb0bf01-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:17 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.377s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:17 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:09:17 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-1074cf46-fb46-4b41-8560-12418fb0bf01" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-67b4769d-a885-4534-9635-2be289358fe8 tempest-VolumesGetTest-1465116479 None] Lock "cinder-38d0146e-0e0e-48a8-99cc-26f26062abfa-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-1074cf46-fb46-4b41-8560-12418fb0bf01" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13c9cf-1805-46ed-827b-8043d3dfcda3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:17 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.593s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:17 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 Jul 17 07:09:17 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:17 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.367s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:17 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1436596d-baec-4f8f-8d69-479e8e7043bb tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Retype volume completed successfully. Jul 17 07:09:17 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 Jul 17 07:09:17 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:18 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01" returned: 0 in 0.539s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:18 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01 Jul 17 07:09:18 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:18 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1074cf46-fb46-4b41-8560-12418fb0bf01" returned: 0 in 0.401s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-1074cf46-fb46-4b41-8560-12418fb0bf01" released by "delete_volume" :: held 1.035s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:18 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Created reservations ['44c66620-2f94-417e-b0b9-b202dd80b792', '90b7da32-6a37-4d14-98a6-bd92bf1e14be', '1c1a3c39-0d0a-4f4c-9646-00b4874f32a4', '83a005e5-af07-4f22-aace-e751c0b4985a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Acquiring lock "cinder-20ac7b2e-62e6-4570-adb8-6990ccb42d53-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "cinder-20ac7b2e-62e6-4570-adb8-6990ccb42d53-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:19 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:19 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Acquiring lock "cinder-quobyte-20ac7b2e-62e6-4570-adb8-6990ccb42d53" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "cinder-quobyte-20ac7b2e-62e6-4570-adb8-6990ccb42d53" acquired by "delete_volume" :: waited 0.111s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d2abe9-e2bc-4e8b-b225-e9ecf05d523e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:19 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.603s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:09:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69d4209d-b967-472f-a144-547124436934 tempest-VolumesGetTest-1465116479 None] Lock "cinder-1074cf46-fb46-4b41-8560-12418fb0bf01-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:19 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 Jul 17 07:09:19 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-db825d13-fd29-4e4d-9523-8b5faa37fd64-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Lock "cinder-db825d13-fd29-4e4d-9523-8b5faa37fd64-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-db825d13-fd29-4e4d-9523-8b5faa37fd64" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-db825d13-fd29-4e4d-9523-8b5faa37fd64" acquired by "delete_volume" :: waited 0.055s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[01551dac-358d-4cf1-97f7-64f3e15fa6b3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:20 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:09:20 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:21 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53" returned: 0 in 1.555s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:21 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53 Jul 17 07:09:21 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:21 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.992s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:21 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64 Jul 17 07:09:21 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:21 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-20ac7b2e-62e6-4570-adb8-6990ccb42d53" returned: 0 in 0.577s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "cinder-quobyte-20ac7b2e-62e6-4570-adb8-6990ccb42d53" released by "delete_volume" :: held 2.286s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:21 devstack cinder-volume[87331]: WARNING cinder.quota [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:09:21 devstack cinder-volume[87331]: WARNING cinder.quota [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:09:21 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Created reservations ['ab5c4c1c-7b07-4696-a73b-3dd1c9c8f671', '443d1c33-9bd0-4644-9805-16da5540fcf6', 'e486e2a8-b462-4b26-becf-0ddfa8929580', '589be8f3-a81e-40e8-a3bd-4c3487cedd88'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:22 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:22 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:22 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-db825d13-fd29-4e4d-9523-8b5faa37fd64" returned: 0 in 0.725s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-db825d13-fd29-4e4d-9523-8b5faa37fd64" released by "delete_volume" :: held 1.912s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Created reservations ['5735fc6b-9435-47e9-8c39-f44d11940100', '6233d529-ff86-4373-a652-31843bdc5eaf', '4a23395a-f72d-4847-a6ba-67e128ad19c4', 'eb7a5cdf-021e-4fa1-929f-9d4cd130c64b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:22 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.556s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Deleted volume successfully. Jul 17 07:09:22 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:22 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2c5a0888-7e2f-4f90-8b34-6de587724cd6 tempest-VolumeRetypeWithoutMigrationTest-1010850339 None] Lock "cinder-20ac7b2e-62e6-4570-adb8-6990ccb42d53-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:23 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.542s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:23 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:09:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-030b33ae-cc4f-49d0-9c97-5f4ba718acc7 tempest-VolumesGetTest-1465116479 None] Lock "cinder-db825d13-fd29-4e4d-9523-8b5faa37fd64-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:24 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425" returned: 0 in 6.605s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7661dd-8b49-4bd7-8ce9-c5c4ea5da36d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:24 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:24 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (db78bf3a-86c8-4e30-b45d-c2c38b15638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e79dbc-d51d-4b78-8317-bfe4d28b2f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e79dbc-d51d-4b78-8317-bfe4d28b2f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-757907566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c93a7c-5773-4fb6-ab6e-9025cb5b6399,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:24Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26772235-e4ba-4842-9fc4-8313e9392d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26772235-e4ba-4842-9fc4-8313e9392d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f62b294-ee68-49c0-85e8-76592d341112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:24 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:09:25 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.757s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:09:25 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Converted 1024.00 MB image at 155.01 MB/s Jul 17 07:09:25 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 is being set with open permissions: ugo+rw Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:25 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 Jul 17 07:09:25 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f62b294-ee68-49c0-85e8-76592d341112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09c93a7c-5773-4fb6-ab6e-9025cb5b6399', 'volume_name': 'volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a4fd7-0691-4028-b371-0dcae00aacda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2a4fd7-0691-4028-b371-0dcae00aacda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a337e127-db1f-48dc-822e-8e1fbf295fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:25 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Volume 09c93a7c-5773-4fb6-ab6e-9025cb5b6399: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Trying to clone 09c93a7c-5773-4fb6-ab6e-9025cb5b6399 from image d615f633-2881-4d59-aa2e-ff4db61859d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:09:25 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425" returned: 0 in 0.298s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-70021251-cc9d-4c87-89c1-ce8bd7c54425" released by "_copy_volume_from_snapshot" :: held 8.929s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cf8202cd-895d-4317-8a70-1ce5c85a9946-70021251-cc9d-4c87-89c1-ce8bd7c54425" released by "_create_volume_from_snapshot" :: held 8.976s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.029s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38d1c13-7b00-431f-baad-6c0d5ed20b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70021251-cc9d-4c87-89c1-ce8bd7c54425', 'volume_size': 1, 'snapshot_id': 'cf8202cd-895d-4317-8a70-1ce5c85a9946'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39f95c3-ce2a-4054-bea3-d08aba440f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:25 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Volume volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 (70021251-cc9d-4c87-89c1-ce8bd7c54425): created successfully Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39f95c3-ce2a-4054-bea3-d08aba440f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Flow 'volume_create_manager' (4e6dd1a7-855a-47eb-83e8-01b51007ff5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3f9f1a40-6e25-4d3a-b6dd-34f67596143d tempest-VolumesSnapshotTestJSON-1039071146 None] Created volume successfully. Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:09:25 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Image download 20.69 MB at 20.69 MB/s Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3316f140-687d-4c21-b91d-568438b4c757]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:26 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD Jul 17 07:09:26 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:26 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 is fetched for user 08d78d252306437498176541e294cc9e. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-70021251-cc9d-4c87-89c1-ce8bd7c54425-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-70021251-cc9d-4c87-89c1-ce8bd7c54425-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-70021251-cc9d-4c87-89c1-ce8bd7c54425" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-70021251-cc9d-4c87-89c1-ce8bd7c54425" acquired by "delete_volume" :: waited 0.041s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee09791-5139-4010-88a2-6ed5dc94c118]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c66664-530c-4975-b12d-f126e4e630af]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:26 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD Jul 17 07:09:26 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:26 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 Jul 17 07:09:26 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:27 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-757907566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c93a7c-5773-4fb6-ab6e-9025cb5b6399,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:24Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Creating volume 09c93a7c-5773-4fb6-ab6e-9025cb5b6399 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:27 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:27 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 1073741824 Jul 17 07:09:27 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:27 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425" returned: 0 in 0.534s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:27 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425 Jul 17 07:09:27 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:27 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70021251-cc9d-4c87-89c1-ce8bd7c54425" returned: 0 in 0.379s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-70021251-cc9d-4c87-89c1-ce8bd7c54425" released by "delete_volume" :: held 0.970s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:27 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 1073741824" returned: 0 in 0.572s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['5ec6fa0c-30ab-474d-854f-4d829ae29d42', '9ae8b005-7de0-417d-90b6-5d955ed9b753', 'ca629e86-e5bb-4644-b262-882677fe849d', '59f732ed-c985-4cac-a3f1-302ffafe0242'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:27 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 Jul 17 07:09:27 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:27 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:27 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:27 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" returned: 0 in 0.359s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:28 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Attempting download of d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume 09c93a7c-5773-4fb6-ab6e-9025cb5b6399. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:09:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Deleted volume successfully. Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-77511836-194e-41a7-8d85-9ba462ae6d5c tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-70021251-cc9d-4c87-89c1-ce8bd7c54425-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0368bf55-3326-418b-9128-f968cf2f7c1e]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:28 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti Jul 17 07:09:28 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:28 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti" returned: 0 in 0.359s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:28 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti Jul 17 07:09:28 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-cf8202cd-895d-4317-8a70-1ce5c85a9946-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-cf8202cd-895d-4317-8a70-1ce5c85a9946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-85358893-f865-4410-ab08-d5c7b88fe571" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-85358893-f865-4410-ab08-d5c7b88fe571" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-cf8202cd-895d-4317-8a70-1ce5c85a9946" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cf8202cd-895d-4317-8a70-1ce5c85a9946" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Deleting offline snapshot cf8202cd-895d-4317-8a70-1ce5c85a9946 of volume 85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:09:28 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] snapshot_file for this snap is: volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti" returned: 1 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_7ojig8ti' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a3738-9460-4f80-95fd-4487c36068d8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[55044453-180b-4f63-8685-c2f3dfc32afc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:29 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 Jul 17 07:09:29 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:29 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD Jul 17 07:09:29 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:29 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] d615f633-2881-4d59-aa2e-ff4db61859d1 was qcow2, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:29 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85358893-f865-4410-ab08-d5c7b88fe571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:29 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 Jul 17 07:09:29 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8aa9c-0281-4cec-831d-b55c1d01e93a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:29 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:29 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:29 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.468s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:29 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:29 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:29 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 Jul 17 07:09:29 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:30 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:09:30 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946" returned: 0 in 0.564s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:30 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946 Jul 17 07:09:30 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:30 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571.cf8202cd-895d-4317-8a70-1ce5c85a9946" returned: 0 in 0.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-cf8202cd-895d-4317-8a70-1ce5c85a9946" released by "_delete_snapshot" :: held 1.918s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-85358893-f865-4410-ab08-d5c7b88fe571" released by "delete_snapshot" :: held 1.955s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:30 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['74210b6b-93b8-45a9-9f88-cbfb791ec3ff', '0ec6f736-80a4-4344-8813-efde796fdc65', 'f3b56818-efa8-45d0-97c7-998c20361d5e', '8c1d25e8-901f-414c-987e-65bca58ad4eb'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Delete snapshot completed successfully. Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2b17c867-7523-4871-83e6-481d6dd25c1d tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-cf8202cd-895d-4317-8a70-1ce5c85a9946-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:31 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" returned: 0 in 2.144s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ztxa3gd2devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:09:31 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Converted 112.00 MB image at 52.17 MB/s Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:31 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 1G Jul 17 07:09:31 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Flow 'volume_create_manager' (cfe110e9-9dea-4bff-aa95-73baf3462134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff97ef7d-e7c8-472c-b174-511260e25ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff97ef7d-e7c8-472c-b174-511260e25ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1304417142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99721614-8586-4d67-9be0-0964f8b591e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc66793c54c49bc97e69e82bb3786f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:32Z,use_quota=True,user_id='389f3f73e13d4db08c7bd7273b1580c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f50c09-1bda-4790-8e46-efe39aab13db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f50c09-1bda-4790-8e46-efe39aab13db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6ae54d-4e40-4f51-8e92-14bad9fd59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6ae54d-4e40-4f51-8e92-14bad9fd59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99721614-8586-4d67-9be0-0964f8b591e3', 'volume_name': 'volume-99721614-8586-4d67-9be0-0964f8b591e3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e67c3b2-d79f-4745-bda1-c217c7f53638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e67c3b2-d79f-4745-bda1-c217c7f53638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2977120-ab5b-4b06-b325-39bf21f5c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:31 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Volume 99721614-8586-4d67-9be0-0964f8b591e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99721614-8586-4d67-9be0-0964f8b591e3', 'volume_size': 1} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1304417142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99721614-8586-4d67-9be0-0964f8b591e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc66793c54c49bc97e69e82bb3786f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:32Z,use_quota=True,user_id='389f3f73e13d4db08c7bd7273b1580c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Creating volume 99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:31 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:32 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 1073741824 Jul 17 07:09:32 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:32 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 1G" returned: 0 in 0.539s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Downloaded image d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume 09c93a7c-5773-4fb6-ab6e-9025cb5b6399 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 for user 08d78d252306437498176541e294cc9e is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Marking volume 09c93a7c-5773-4fb6-ab6e-9025cb5b6399 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Copying metadata from image d615f633-2881-4d59-aa2e-ff4db61859d1 to 09c93a7c-5773-4fb6-ab6e-9025cb5b6399. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Creating volume glance metadata for volume 09c93a7c-5773-4fb6-ab6e-9025cb5b6399 backed by image d615f633-2881-4d59-aa2e-ff4db61859d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a337e127-db1f-48dc-822e-8e1fbf295fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f197686-4b85-4082-83f2-04ce6c36e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:32 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Volume volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 (09c93a7c-5773-4fb6-ab6e-9025cb5b6399): created successfully Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f197686-4b85-4082-83f2-04ce6c36e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (db78bf3a-86c8-4e30-b45d-c2c38b15638b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d5eee833-e546-42ba-a96f-b493b6b399e2 tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-85358893-f865-4410-ab08-d5c7b88fe571-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-85358893-f865-4410-ab08-d5c7b88fe571-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-85358893-f865-4410-ab08-d5c7b88fe571" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-85358893-f865-4410-ab08-d5c7b88fe571" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a923183c-f6b0-46fd-a125-5712a7a83a5d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:32 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 1073741824" returned: 0 in 0.617s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:32 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:32 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:32 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 Jul 17 07:09:32 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:32 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.410s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:32 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3" returned: 0 in 0.298s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:32 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571 Jul 17 07:09:32 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2977120-ab5b-4b06-b325-39bf21f5c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99721614-8586-4d67-9be0-0964f8b591e3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f564839-ecc7-42eb-bea9-7c77aef9602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:32 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Volume volume-99721614-8586-4d67-9be0-0964f8b591e3 (99721614-8586-4d67-9be0-0964f8b591e3): created successfully Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f564839-ecc7-42eb-bea9-7c77aef9602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Flow 'volume_create_manager' (cfe110e9-9dea-4bff-aa95-73baf3462134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2bbccd11-672e-4420-93e7-8979863d07bd tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Created volume successfully. Jul 17 07:09:33 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85358893-f865-4410-ab08-d5c7b88fe571" returned: 0 in 0.284s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-85358893-f865-4410-ab08-d5c7b88fe571" released by "delete_volume" :: held 0.765s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['c837ae85-3416-4cf7-8110-8856777f80a9', '01b09236-1c02-4f73-bbe7-61d1069908ad', 'd658696b-226f-4e5a-9225-75be045628b2', '82e011b1-c777-4f39-bbd7-e28aab834a05'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:33 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:33 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-b8f2d92b-b608-4487-a319-10e02033fb81-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-b8f2d92b-b608-4487-a319-10e02033fb81-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:33 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.335s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Deleted volume successfully. Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec560729-e05f-4c01-9d69-918c90b644cc tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-85358893-f865-4410-ab08-d5c7b88fe571-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "cinder-quobyte-b8f2d92b-b608-4487-a319-10e02033fb81" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-b8f2d92b-b608-4487-a319-10e02033fb81" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[12689e44-f3c7-480c-bb3b-3c8a22c16fe4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:34 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 Jul 17 07:09:34 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (523204df-4c49-4a76-9b44-61db3ff47550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:34 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed91bed-1b6c-471a-a6c0-6c824fd2e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81" returned: 0 in 0.500s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Creating offline snapshot 4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 of volume 99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:09:34 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81 Jul 17 07:09:34 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed91bed-1b6c-471a-a6c0-6c824fd2e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279678101',display_name='tempest-VolumesGetTest-Volume-394959359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c89f16-36d6-45f7-898c-eb12b9496383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:34Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3b4b5f-c49a-4f53-9738-cfb9acd553bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3b4b5f-c49a-4f53-9738-cfb9acd553bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78043134-1538-4b3a-8ea4-c9098f5cca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78043134-1538-4b3a-8ea4-c9098f5cca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c89f16-36d6-45f7-898c-eb12b9496383', 'volume_name': 'volume-b6c89f16-36d6-45f7-898c-eb12b9496383', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f320f21-6c1f-404f-bafc-4ede7faaa4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f320f21-6c1f-404f-bafc-4ede7faaa4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cdff2b-8ae0-4584-b1f5-9dd47f755770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Volume b6c89f16-36d6-45f7-898c-eb12b9496383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c89f16-36d6-45f7-898c-eb12b9496383', 'volume_size': 1} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2808e4fb-2147-4628-8120-9162386da9f0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:34 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 Jul 17 07:09:34 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:34 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b8f2d92b-b608-4487-a319-10e02033fb81" returned: 0 in 0.328s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-quobyte-b8f2d92b-b608-4487-a319-10e02033fb81" released by "delete_volume" :: held 0.923s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:34 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Created reservations ['369228ed-0a26-45be-9234-3b83e4e57aab', '02080e21-b6f1-4662-b407-828f136671d3', '97b64099-f6f7-46fb-9d4a-7f459d7349bc', '107cb992-5585-4d41-be5f-4e209d852258'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:35 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:35 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:35 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3" returned: 0 in 0.624s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:35 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 1G Jul 17 07:09:35 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:35 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.320s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Deleted volume successfully. Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-002cca20-5b7b-4da2-9c93-7222ccc63381 tempest-VolumesSnapshotTestJSON-1039071146 None] Lock "cinder-b8f2d92b-b608-4487-a319-10e02033fb81-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:35 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 1G" returned: 0 in 0.456s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99721614-8586-4d67-9be0-0964f8b591e3 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:35 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99721614-8586-4d67-9be0-0964f8b591e3 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 Jul 17 07:09:35 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:35 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99721614-8586-4d67-9be0-0964f8b591e3 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" returned: 0 in 0.320s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:35 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 is being set with open permissions: ugo+rw Jul 17 07:09:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:35 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 Jul 17 07:09:35 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:36 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:36 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info Jul 17 07:09:36 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:36 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:36 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info is being set with open permissions: ugo+rw Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:36 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info Jul 17 07:09:36 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:36 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.info" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.351s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279678101',display_name='tempest-VolumesGetTest-Volume-394959359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c89f16-36d6-45f7-898c-eb12b9496383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c684fc9d71204953b40b92dac3afdd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:34Z,use_quota=True,user_id='08d78d252306437498176541e294cc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Creating volume b6c89f16-36d6-45f7-898c-eb12b9496383 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:36 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:36 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 1073741824 Jul 17 07:09:36 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d4d1ca5b-5037-4343-b0e1-e83e7c8addaf tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Create snapshot completed successfully Jul 17 07:09:37 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 1073741824" returned: 0 in 0.564s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:37 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 Jul 17 07:09:37 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:37 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383" returned: 0 in 0.358s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cdff2b-8ae0-4584-b1f5-9dd47f755770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c89f16-36d6-45f7-898c-eb12b9496383', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d918f77-4ae7-412e-8d84-9db84565cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:37 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Volume volume-b6c89f16-36d6-45f7-898c-eb12b9496383 (b6c89f16-36d6-45f7-898c-eb12b9496383): created successfully Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d918f77-4ae7-412e-8d84-9db84565cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Flow 'volume_create_manager' (523204df-4c49-4a76-9b44-61db3ff47550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:37 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-33e99de1-e329-4fcd-a7b4-7352ac7bf85d tempest-VolumesGetTest-1465116479 None] Created volume successfully. Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "cinder-4478c78d-ae7c-4e75-95bd-8a92c89a7fb2-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-4478c78d-ae7c-4e75-95bd-8a92c89a7fb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "cinder-quobyte-99721614-8586-4d67-9be0-0964f8b591e3" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-quobyte-99721614-8586-4d67-9be0-0964f8b591e3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "cinder-quobyte-4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-quobyte-4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Deleting offline snapshot 4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 of volume 99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] snapshot_file for this snap is: volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f32dea-2ebd-4140-97c5-05d0d542a7be]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:38 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 Jul 17 07:09:38 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:38 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" returned: 0 in 0.527s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99721614-8586-4d67-9be0-0964f8b591e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-b6c89f16-36d6-45f7-898c-eb12b9496383-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f50e3-4204-43db-8dea-f7c38f7d4861]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Lock "cinder-b6c89f16-36d6-45f7-898c-eb12b9496383-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-b6c89f16-36d6-45f7-898c-eb12b9496383" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-b6c89f16-36d6-45f7-898c-eb12b9496383" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a00bbe-5145-492b-a2a1-7598167cc774]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:38 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 Jul 17 07:09:38 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:39 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 Jul 17 07:09:39 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:39 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3" returned: 0 in 0.505s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:39 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 Jul 17 07:09:39 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:39 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383" returned: 0 in 0.502s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:39 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383 Jul 17 07:09:39 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:39 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:39 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" returned: 0 in 0.499s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b6c89f16-36d6-45f7-898c-eb12b9496383" returned: 0 in 0.362s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:39 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2 Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-b6c89f16-36d6-45f7-898c-eb12b9496383" released by "delete_volume" :: held 0.949s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:39 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Created reservations ['d56106b8-f1c2-4ca7-a29b-ac3f78b1cd3e', '570d2d7d-15de-4dfc-891c-aacd533e5252', 'c0d7ff27-8207-41a5-98df-42c501196665', '1b0a6dc8-c35c-424e-8d6c-1783f105211b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:40 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:40 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:40 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3.4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" returned: 0 in 0.320s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-quobyte-4478c78d-ae7c-4e75-95bd-8a92c89a7fb2" released by "_delete_snapshot" :: held 2.040s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-quobyte-99721614-8586-4d67-9be0-0964f8b591e3" released by "delete_snapshot" :: held 2.075s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Created reservations ['5309a174-6afb-4805-bcb3-d9527eebb666', '5264ffdf-92fb-41db-88d4-e3f17209f4bd', '17a90d9a-d512-42e9-aa02-a5d0161ccfe4', '6ab5fd6b-f5dc-4461-9e92-6eb5d44993b4'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:40 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.328s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Delete snapshot completed successfully. Jul 17 07:09:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d8735f3c-8145-44d0-b0c1-716c68239e7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-4478c78d-ae7c-4e75-95bd-8a92c89a7fb2-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3eb9cc71-d775-4e32-b3b6-4769f3de4020 tempest-VolumesGetTest-1465116479 None] Lock "cinder-b6c89f16-36d6-45f7-898c-eb12b9496383-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-09c93a7c-5773-4fb6-ab6e-9025cb5b6399-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Lock "cinder-09c93a7c-5773-4fb6-ab6e-9025cb5b6399-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Acquiring lock "cinder-quobyte-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b9810-30b4-45f1-849f-c3855a61fbc5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:41 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 Jul 17 07:09:41 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "cinder-99721614-8586-4d67-9be0-0964f8b591e3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-99721614-8586-4d67-9be0-0964f8b591e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "cinder-quobyte-99721614-8586-4d67-9be0-0964f8b591e3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-quobyte-99721614-8586-4d67-9be0-0964f8b591e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8872894-7530-4533-b75f-34601a0ad19d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:41 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" returned: 0 in 0.509s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:41 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 Jul 17 07:09:41 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:41 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399 Jul 17 07:09:41 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:42 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" returned: 0 in 0.323s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Lock "cinder-quobyte-09c93a7c-5773-4fb6-ab6e-9025cb5b6399" released by "delete_volume" :: held 0.915s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Created reservations ['380c6416-5375-45cc-a7c4-e464b4feebf2', '130b7d79-c97f-4fa5-be88-650cab4c4bb4', '4d53a98b-49fd-46d8-a3cf-f22fb15dd2c0', '069f7176-451b-47ab-990e-95b3a017f7c8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:42 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3" returned: 0 in 0.612s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:42 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3 Jul 17 07:09:42 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:42 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:42 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:42 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:42 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Deleted volume successfully. Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99721614-8586-4d67-9be0-0964f8b591e3" returned: 0 in 0.542s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-quobyte-99721614-8586-4d67-9be0-0964f8b591e3" released by "delete_volume" :: held 1.270s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20c0dc1a-7ae7-4a05-b066-8f9069eb6589 tempest-VolumesGetTest-1465116479 None] Lock "cinder-09c93a7c-5773-4fb6-ab6e-9025cb5b6399-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:42 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Created reservations ['deb68d63-340d-42b2-8ffe-1bd503116b19', 'f483d62f-2abe-452e-aed0-58a79d1e1e82', 'df6ac016-4700-42d5-877b-39ac033569c3', 'c8eb95cf-15de-42ce-9e01-c9f20514d20d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:43 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:43 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:43 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.450s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Deleted volume successfully. Jul 17 07:09:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a5955961-e744-48b1-9dff-48cfae112179 tempest-VolumeSnapshotQuotasNegativeTestJSON-1949745053 None] Lock "cinder-99721614-8586-4d67-9be0-0964f8b591e3-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Flow 'volume_create_manager' (9bb78af2-db47-4c44-bdd3-0b3214055946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c195f595-262c-418e-98f6-205078dad5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c195f595-262c-418e-98f6-205078dad5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1658435897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e41dfa-a2c1-4ef4-b340-d372441ae953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cfb92966274a5295c5dd0a5ac094e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:45Z,use_quota=True,user_id='2cb14a7ab8174238b27e909892718004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab134901-842e-4101-84b3-7dd2387be99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab134901-842e-4101-84b3-7dd2387be99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15169ae5-799e-41a3-9e50-821dbce4d87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15169ae5-799e-41a3-9e50-821dbce4d87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e41dfa-a2c1-4ef4-b340-d372441ae953', 'volume_name': 'volume-52e41dfa-a2c1-4ef4-b340-d372441ae953', 'volume_size': 2}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1d3a6f-b77a-45ae-913a-94963a62f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1d3a6f-b77a-45ae-913a-94963a62f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a253c66b-d151-47c7-9e1d-4ef79a76c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Volume 52e41dfa-a2c1-4ef4-b340-d372441ae953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e41dfa-a2c1-4ef4-b340-d372441ae953', 'volume_size': 2} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1658435897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e41dfa-a2c1-4ef4-b340-d372441ae953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cfb92966274a5295c5dd0a5ac094e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:45Z,use_quota=True,user_id='2cb14a7ab8174238b27e909892718004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Creating volume 52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 2147483648 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:44 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 2147483648 Jul 17 07:09:44 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:45 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 2147483648" returned: 0 in 0.852s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:45 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 Jul 17 07:09:45 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:46 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953" returned: 0 in 0.452s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a253c66b-d151-47c7-9e1d-4ef79a76c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e41dfa-a2c1-4ef4-b340-d372441ae953', 'volume_size': 2}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516647bf-3657-4ba1-8059-86a94f27a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:46 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Volume volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 (52e41dfa-a2c1-4ef4-b340-d372441ae953): created successfully Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516647bf-3657-4ba1-8059-86a94f27a33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Flow 'volume_create_manager' (9bb78af2-db47-4c44-bdd3-0b3214055946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:46 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1f01a0bf-4aaf-4985-948b-45c4fdf7148f tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Created volume successfully. Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Creating offline snapshot 81fac298-dd14-49d1-b708-664e3533d66b of volume 52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5283c348-c328-41d3-8d72-39fbc20dc5c3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:47 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 Jul 17 07:09:47 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:47 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953" returned: 0 in 0.530s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b 2G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:47 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b 2G Jul 17 07:09:47 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:48 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b 2G" returned: 0 in 0.751s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:48 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b Jul 17 07:09:48 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:49 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b" returned: 0 in 0.577s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:49 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b is being set with open permissions: ugo+rw Jul 17 07:09:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:49 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b Jul 17 07:09:49 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:49 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b" returned: 0 in 0.333s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:49 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info Jul 17 07:09:49 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:49 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:50 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info is being set with open permissions: ugo+rw Jul 17 07:09:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:50 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info Jul 17 07:09:50 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:50 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.info" returned: 0 in 0.453s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.237s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:50 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-5c229bb5-1fea-4925-b7e3-4f0d3d476042 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Create snapshot completed successfully Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (c784dff9-1b9e-464c-b235-de623f2d6f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98acb0c9-089f-4ee4-a1a1-3c2328a2d5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98acb0c9-089f-4ee4-a1a1-3c2328a2d5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1065606378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3077ba91-8c9b-446a-841a-83c89d2e63a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:51Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf72213-0eee-4872-970c-951742de3938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf72213-0eee-4872-970c-951742de3938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82af2f60-bc20-4eaa-9e13-afbdafdc651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82af2f60-bc20-4eaa-9e13-afbdafdc651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3077ba91-8c9b-446a-841a-83c89d2e63a1', 'volume_name': 'volume-3077ba91-8c9b-446a-841a-83c89d2e63a1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5137352e-bb53-4fc3-bc40-d836283ca327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5137352e-bb53-4fc3-bc40-d836283ca327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8c1789-fb04-4808-8536-c7e919f21d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:51 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Volume 3077ba91-8c9b-446a-841a-83c89d2e63a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3077ba91-8c9b-446a-841a-83c89d2e63a1', 'volume_size': 1} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1065606378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3077ba91-8c9b-446a-841a-83c89d2e63a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:09:51Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Creating volume 3077ba91-8c9b-446a-841a-83c89d2e63a1 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:09:51 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:51 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 1073741824 Jul 17 07:09:51 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "cinder-81fac298-dd14-49d1-b708-664e3533d66b-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-81fac298-dd14-49d1-b708-664e3533d66b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "cinder-quobyte-52e41dfa-a2c1-4ef4-b340-d372441ae953" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-quobyte-52e41dfa-a2c1-4ef4-b340-d372441ae953" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "cinder-quobyte-81fac298-dd14-49d1-b708-664e3533d66b" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-quobyte-81fac298-dd14-49d1-b708-664e3533d66b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Deleting offline snapshot 81fac298-dd14-49d1-b708-664e3533d66b of volume 52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] snapshot_file for this snap is: volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d37e4-154e-46e9-97a4-01d2a11d1457]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:52 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 1073741824" returned: 0 in 0.808s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:52 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b Jul 17 07:09:52 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:52 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 Jul 17 07:09:52 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:52 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1" returned: 0 in 0.340s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:52 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b" returned: 0 in 0.563s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e41dfa-a2c1-4ef4-b340-d372441ae953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8c1789-fb04-4808-8536-c7e919f21d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3077ba91-8c9b-446a-841a-83c89d2e63a1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc2ecb1-f938-4b0d-9e38-d4e1d1b45551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3826ee-adf6-4429-838e-6d91760af61b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:52 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Volume volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 (3077ba91-8c9b-446a-841a-83c89d2e63a1): created successfully Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc2ecb1-f938-4b0d-9e38-d4e1d1b45551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:09:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (c784dff9-1b9e-464c-b235-de623f2d6f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:09:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e26a7f74-b26a-49b5-aaca-3734972500de tempest-VolumesActionsTest-479036878 None] Created volume successfully. Jul 17 07:09:52 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 Jul 17 07:09:52 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:53 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953" returned: 0 in 0.465s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:53 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b Jul 17 07:09:53 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-61a6e400-6c32-4d74-9ea5-881a0f57e731 tempest-VolumesActionsTest-479036878 None] Acquiring lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1" by "attach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-61a6e400-6c32-4d74-9ea5-881a0f57e731 tempest-VolumesActionsTest-479036878 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1" acquired by "attach_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-61a6e400-6c32-4d74-9ea5-881a0f57e731 tempest-VolumesActionsTest-479036878 None] Attaching volume 3077ba91-8c9b-446a-841a-83c89d2e63a1 to instance 1930da41-b71c-4c1f-856a-09ed91b9ebf4 at mountpoint /dev/vdb on host None. Jul 17 07:09:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-61a6e400-6c32-4d74-9ea5-881a0f57e731 tempest-VolumesActionsTest-479036878 None] Attach volume completed successfully. Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-61a6e400-6c32-4d74-9ea5-881a0f57e731 tempest-VolumesActionsTest-479036878 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1" released by "attach_volume" :: held 0.200s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:53 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b" returned: 0 in 0.654s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:53 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b Jul 17 07:09:53 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:54 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953.81fac298-dd14-49d1-b708-664e3533d66b" returned: 0 in 0.573s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-quobyte-81fac298-dd14-49d1-b708-664e3533d66b" released by "_delete_snapshot" :: held 2.432s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-quobyte-52e41dfa-a2c1-4ef4-b340-d372441ae953" released by "delete_snapshot" :: held 2.473s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Created reservations ['6bde5754-bfaf-413b-8d11-1bc8a599b40e', 'bdc0287a-93e7-4ea7-b787-1843d7df8001', '23fc6c48-da87-4509-b848-3e5311af19a2', '6cb4a4dc-ae7c-4a38-b633-71591db3d83d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e5601457-0e77-4116-b11b-46fe6a767cc8 tempest-VolumesActionsTest-65625 None] Terminate volume connection completed successfully. Jul 17 07:09:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Delete snapshot completed successfully. Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9d0e6967-8809-4649-bc3c-71d086b5ff9d tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-81fac298-dd14-49d1-b708-664e3533d66b-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e5601457-0e77-4116-b11b-46fe6a767cc8 tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-detach_volume" by "detach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e5601457-0e77-4116-b11b-46fe6a767cc8 tempest-VolumesActionsTest-65625 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e5601457-0e77-4116-b11b-46fe6a767cc8 tempest-VolumesActionsTest-65625 None] Detaching volume 3077ba91-8c9b-446a-841a-83c89d2e63a1 from instance 1930da41-b71c-4c1f-856a-09ed91b9ebf4. Jul 17 07:09:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e5601457-0e77-4116-b11b-46fe6a767cc8 tempest-VolumesActionsTest-65625 None] Detach volume completed successfully. Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e5601457-0e77-4116-b11b-46fe6a767cc8 tempest-VolumesActionsTest-65625 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-380056c7-c8c2-479a-90de-a449032036a8 tempest-VolumesActionsTest-479036878 None] Acquiring lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-detach_volume" by "detach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-380056c7-c8c2-479a-90de-a449032036a8 tempest-VolumesActionsTest-479036878 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:55 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-380056c7-c8c2-479a-90de-a449032036a8 tempest-VolumesActionsTest-479036878 None] Volume detach called, but volume not attached. Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-380056c7-c8c2-479a-90de-a449032036a8 tempest-VolumesActionsTest-479036878 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "cinder-52e41dfa-a2c1-4ef4-b340-d372441ae953-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-52e41dfa-a2c1-4ef4-b340-d372441ae953-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Acquiring lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "cinder-quobyte-52e41dfa-a2c1-4ef4-b340-d372441ae953" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-quobyte-52e41dfa-a2c1-4ef4-b340-d372441ae953" acquired by "delete_volume" :: waited 0.040s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0853b930-7dd1-4169-8c9b-55c9605ee0ab]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Acquiring lock "cinder-quobyte-3077ba91-8c9b-446a-841a-83c89d2e63a1" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Lock "cinder-quobyte-3077ba91-8c9b-446a-841a-83c89d2e63a1" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989f939-802b-4f03-a356-149c20e1371a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:09:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:55 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 Jul 17 07:09:55 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:56 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 Jul 17 07:09:56 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:56 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953" returned: 0 in 0.603s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:56 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953 Jul 17 07:09:56 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:56 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1" returned: 0 in 0.769s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:56 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1 Jul 17 07:09:56 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:56 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-52e41dfa-a2c1-4ef4-b340-d372441ae953" returned: 0 in 0.497s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-quobyte-52e41dfa-a2c1-4ef4-b340-d372441ae953" released by "delete_volume" :: held 1.247s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Created reservations ['3f5c8d5a-cee4-4a56-91ab-dc4a34ff57e4', '625850fb-9032-49fc-9d7f-f931e5dbe6b7', 'ef57ca7f-736f-4bb5-b41c-e5177293b5e5', 'e21b79d6-4ce5-416d-aeee-373d81294fbc'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:57 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:57 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:57 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3077ba91-8c9b-446a-841a-83c89d2e63a1" returned: 0 in 0.669s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Lock "cinder-quobyte-3077ba91-8c9b-446a-841a-83c89d2e63a1" released by "delete_volume" :: held 1.526s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Created reservations ['05235d11-b227-4c26-ad5a-83a2e12e07db', '9cd03acc-e62d-4019-96bb-0dc382c35d48', '258a1a39-ee1d-400b-82f6-6095bfd894a5', 'c2801e3f-5090-4f10-9463-c845f9c62658'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:09:57 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:09:57 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:09:57 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.485s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Deleted volume successfully. Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-2ff185a9-4efb-4224-ae00-7667c0e367f8 tempest-VolumesSnapshotNegativeTestJSON-1785000253 None] Lock "cinder-52e41dfa-a2c1-4ef4-b340-d372441ae953-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:09:57 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.526s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:09:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:09:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Deleted volume successfully. Jul 17 07:09:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dd43a9db-6766-4dc7-b3a4-4eced830f91e tempest-VolumesActionsTest-479036878 None] Lock "cinder-3077ba91-8c9b-446a-841a-83c89d2e63a1-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=123,cinder:INSERT=54,cinder:UPDATE=168,cinder:DELETE=9 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=154,cinder:INSERT=41,cinder:UPDATE=172,cinder:DELETE=17 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (c022d413-f90c-464f-b37e-29d158ebe06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e76b455-a367-419d-b53c-ccbd5df63481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e76b455-a367-419d-b53c-ccbd5df63481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972124981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a382978-d959-4979-9608-01ccc220a542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:04Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08418f25-4223-457a-be94-5557c94a643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08418f25-4223-457a-be94-5557c94a643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c0dd3d-0cec-4ece-867e-1ee26a37cec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c0dd3d-0cec-4ece-867e-1ee26a37cec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a382978-d959-4979-9608-01ccc220a542', 'volume_name': 'volume-1a382978-d959-4979-9608-01ccc220a542', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b6f30e-870a-4519-a637-6f783ef562b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b6f30e-870a-4519-a637-6f783ef562b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5bff2d-8a01-4433-a733-7fbdd8e4a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:04 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Volume 1a382978-d959-4979-9608-01ccc220a542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a382978-d959-4979-9608-01ccc220a542', 'volume_size': 1} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972124981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a382978-d959-4979-9608-01ccc220a542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:04Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Creating volume 1a382978-d959-4979-9608-01ccc220a542 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:04 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:04 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 1073741824 Jul 17 07:10:04 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:05 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 1073741824" returned: 0 in 0.582s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:05 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 Jul 17 07:10:05 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:05 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5bff2d-8a01-4433-a733-7fbdd8e4a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a382978-d959-4979-9608-01ccc220a542', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2996d4ca-4b36-45be-9871-ebbf3e169b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Volume volume-1a382978-d959-4979-9608-01ccc220a542 (1a382978-d959-4979-9608-01ccc220a542): created successfully Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2996d4ca-4b36-45be-9871-ebbf3e169b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (c022d413-f90c-464f-b37e-29d158ebe06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-16685d19-9119-496b-9a78-3845256c8c24 tempest-VolumesActionsTest-479036878 None] Created volume successfully. Jul 17 07:10:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-1a382978-d959-4979-9608-01ccc220a542-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Lock "cinder-1a382978-d959-4979-9608-01ccc220a542-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-quobyte-1a382978-d959-4979-9608-01ccc220a542" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-1a382978-d959-4979-9608-01ccc220a542" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620dbb2-d348-416f-98c9-8fa831f1be3b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:07 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 Jul 17 07:10:07 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:07 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542" returned: 0 in 0.480s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:07 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542 Jul 17 07:10:07 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:07 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a382978-d959-4979-9608-01ccc220a542" returned: 0 in 0.375s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-1a382978-d959-4979-9608-01ccc220a542" released by "delete_volume" :: held 0.936s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:07 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Created reservations ['415e4e57-a905-443c-8ba2-3021f501793b', 'ffb3ae0d-4df2-41d2-8fd0-e9cca729f468', 'c7bf042f-7a45-454d-bb4d-f34a01000307', '1945a68c-4333-47cb-8701-b3fcd4af51ce'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:08 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:08 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:08 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.369s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:08 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Deleted volume successfully. Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43ea1ea2-a70d-4a14-9d3c-0e844974fcba tempest-VolumesActionsTest-65625 None] Lock "cinder-1a382978-d959-4979-9608-01ccc220a542-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Flow 'volume_create_manager' (cfba6ff1-c2c6-4805-8a66-d9d974cf59fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4acf97c-a957-4e4a-8229-cacdc7eaa898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4acf97c-a957-4e4a-8229-cacdc7eaa898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-142154640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a3afc5-f004-47b9-9c39-4b9142957189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed27b6bcd5046aaa17741aebb373708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:09Z,use_quota=True,user_id='5aa05a1b00364a109b4f8dbdce574256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24597bcd-b2c9-49b2-85e0-3aae7fe86a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24597bcd-b2c9-49b2-85e0-3aae7fe86a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4be4419-4574-4c2d-9458-dd53393cbd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4be4419-4574-4c2d-9458-dd53393cbd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a3afc5-f004-47b9-9c39-4b9142957189', 'volume_name': 'volume-c0a3afc5-f004-47b9-9c39-4b9142957189', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9596d4df-7532-49f9-b401-5f1885be9c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9596d4df-7532-49f9-b401-5f1885be9c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa0e565-a5c2-4ad0-9587-e7d4ec6418f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Volume c0a3afc5-f004-47b9-9c39-4b9142957189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a3afc5-f004-47b9-9c39-4b9142957189', 'volume_size': 1} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-142154640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a3afc5-f004-47b9-9c39-4b9142957189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed27b6bcd5046aaa17741aebb373708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:09Z,use_quota=True,user_id='5aa05a1b00364a109b4f8dbdce574256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Creating volume c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:08 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:08 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 1073741824 Jul 17 07:10:08 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (a4d825c1-d210-4b45-93d9-869358d8b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9469d-1420-4639-adca-86fab21dd0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9469d-1420-4639-adca-86fab21dd0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839825032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b629646-ad88-4e34-9d18-92e71cdfabf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:09Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ded02ca-6b3a-4ff2-b76d-4d60515aa684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ded02ca-6b3a-4ff2-b76d-4d60515aa684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89d7ce7-d67e-412d-a942-aa88e9e2caea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89d7ce7-d67e-412d-a942-aa88e9e2caea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b629646-ad88-4e34-9d18-92e71cdfabf4', 'volume_name': 'volume-8b629646-ad88-4e34-9d18-92e71cdfabf4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894ac876-01d2-4114-8e36-1f666e15d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894ac876-01d2-4114-8e36-1f666e15d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8063e4fd-dd2c-4bef-995b-8e34c617123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Volume 8b629646-ad88-4e34-9d18-92e71cdfabf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b629646-ad88-4e34-9d18-92e71cdfabf4', 'volume_size': 1} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:09 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 1073741824" returned: 0 in 0.624s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:09 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:09 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:09 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.303s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839825032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b629646-ad88-4e34-9d18-92e71cdfabf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:09Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Creating volume 8b629646-ad88-4e34-9d18-92e71cdfabf4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:09 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:09 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 1073741824 Jul 17 07:10:09 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa0e565-a5c2-4ad0-9587-e7d4ec6418f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a3afc5-f004-47b9-9c39-4b9142957189', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574213d8-5002-4575-a373-bc05bf906ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Volume volume-c0a3afc5-f004-47b9-9c39-4b9142957189 (c0a3afc5-f004-47b9-9c39-4b9142957189): created successfully Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574213d8-5002-4575-a373-bc05bf906ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Flow 'volume_create_manager' (cfba6ff1-c2c6-4805-8a66-d9d974cf59fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ab89a105-7cf3-4095-9c9e-dc96ac0a657c tempest-VolumesDeleteCascade-1863480830 None] Created volume successfully. Jul 17 07:10:10 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 1073741824" returned: 0 in 0.545s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:10 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 Jul 17 07:10:10 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:10 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4" returned: 0 in 0.280s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8063e4fd-dd2c-4bef-995b-8e34c617123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b629646-ad88-4e34-9d18-92e71cdfabf4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2957b4-2d9d-4477-a5ee-b5ff363abe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Volume volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 (8b629646-ad88-4e34-9d18-92e71cdfabf4): created successfully Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2957b4-2d9d-4477-a5ee-b5ff363abe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (a4d825c1-d210-4b45-93d9-869358d8b007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3f29fbbb-4863-481c-8ecb-807fc65ebab0 tempest-VolumesActionsTest-479036878 None] Created volume successfully. Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Creating offline snapshot 412d508e-97a6-4e38-8610-a8b234ab3ac5 of volume c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe8cab-0f35-43d5-8758-6e8dde36e77b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:11 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-8b629646-ad88-4e34-9d18-92e71cdfabf4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:11 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Lock "cinder-8b629646-ad88-4e34-9d18-92e71cdfabf4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-quobyte-8b629646-ad88-4e34-9d18-92e71cdfabf4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-8b629646-ad88-4e34-9d18-92e71cdfabf4" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2e55c-6c35-46bb-83b0-41aad77c2f27]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:11 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.459s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:11 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 1G Jul 17 07:10:11 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 Jul 17 07:10:11 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:11 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:11 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4" returned: 0 in 0.473s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:11 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4 Jul 17 07:10:11 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:12 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 1G" returned: 0 in 0.500s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:12 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:12 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:12 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8b629646-ad88-4e34-9d18-92e71cdfabf4" returned: 0 in 0.429s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-8b629646-ad88-4e34-9d18-92e71cdfabf4" released by "delete_volume" :: held 0.972s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Created reservations ['9062b0e7-2886-4bd2-90b6-d2c516616071', '91e69e47-d450-4d3e-98f0-49faead91191', '6ef6a4c8-c976-4766-b966-d85b5d8d663f', 'ef6ccf81-291a-4e05-b3a2-621318f15d14'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:12 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.477s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:12 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 is being set with open permissions: ugo+rw Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:12 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:12 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:12 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:12 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:12 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.456s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:13 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.478s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Deleted volume successfully. Jul 17 07:10:13 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info Jul 17 07:10:13 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98154102-d112-4ca1-8fef-1343bacf95d2 tempest-VolumesActionsTest-65625 None] Lock "cinder-8b629646-ad88-4e34-9d18-92e71cdfabf4-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:13 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info" returned: 0 in 0.336s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:13 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info is being set with open permissions: ugo+rw Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:13 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info Jul 17 07:10:13 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:13 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.info" returned: 0 in 0.332s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-24f988b2-9f26-4193-a47b-3bc3186381e6 tempest-VolumesDeleteCascade-1863480830 None] Create snapshot completed successfully Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (5c748999-5cf6-4397-9280-41d45feed541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a7bb2e-939c-4d88-bd3a-b1e71de19fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a7bb2e-939c-4d88-bd3a-b1e71de19fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1222456730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf9c3c3-deed-455b-ad00-4c6701256cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:14Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e51fbd-4649-4d23-af28-8d06ed19c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e51fbd-4649-4d23-af28-8d06ed19c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca45a39-5691-41d8-90ad-b35807aa14f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca45a39-5691-41d8-90ad-b35807aa14f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf9c3c3-deed-455b-ad00-4c6701256cde', 'volume_name': 'volume-4bf9c3c3-deed-455b-ad00-4c6701256cde', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c3ceef-efe6-431b-ae91-79eedfe9bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c3ceef-efe6-431b-ae91-79eedfe9bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05616fd-5fc8-4fd2-b0f4-bb9b1a544565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:14 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Volume 4bf9c3c3-deed-455b-ad00-4c6701256cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf9c3c3-deed-455b-ad00-4c6701256cde', 'volume_size': 1} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1222456730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf9c3c3-deed-455b-ad00-4c6701256cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:14Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Creating volume 4bf9c3c3-deed-455b-ad00-4c6701256cde {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:14 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:14 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde 1073741824 Jul 17 07:10:14 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:14 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde 1073741824" returned: 0 in 0.541s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:15 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde Jul 17 07:10:15 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:15 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde" returned: 0 in 0.299s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.766s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05616fd-5fc8-4fd2-b0f4-bb9b1a544565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf9c3c3-deed-455b-ad00-4c6701256cde', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcce9048-2d9c-44bd-b2db-1d1117b823bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Creating offline snapshot bc53fb9b-156b-429f-8902-b2adef84f227 of volume c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:10:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Volume volume-4bf9c3c3-deed-455b-ad00-4c6701256cde (4bf9c3c3-deed-455b-ad00-4c6701256cde): created successfully Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcce9048-2d9c-44bd-b2db-1d1117b823bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (5c748999-5cf6-4397-9280-41d45feed541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e299f2-a80e-46c7-b0bf-f592aaca9f49]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:15 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b12895d5-ba6c-4265-861b-fc875ad2b999 tempest-VolumesActionsTest-479036878 None] Created volume successfully. Jul 17 07:10:15 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:15 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:15 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a3afc5-f004-47b9-9c39-4b9142957189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:15 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 1G Jul 17 07:10:15 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:16 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 1G" returned: 0 in 0.536s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:16 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 Jul 17 07:10:16 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-4bf9c3c3-deed-455b-ad00-4c6701256cde-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Lock "cinder-4bf9c3c3-deed-455b-ad00-4c6701256cde-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-quobyte-4bf9c3c3-deed-455b-ad00-4c6701256cde" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-4bf9c3c3-deed-455b-ad00-4c6701256cde" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029569a-4d64-4ed0-88bc-2ffdf4088b8f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:16 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227" returned: 0 in 0.380s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:16 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 is being set with open permissions: ugo+rw Jul 17 07:10:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:16 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 Jul 17 07:10:16 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:16 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde Jul 17 07:10:16 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:17 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-511b5a6c-a9e6-446c-b82e-1cce9f9436d7 tempest-VolumesDeleteCascade-1863480830 None] Create snapshot completed successfully Jul 17 07:10:17 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde" returned: 0 in 0.536s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:17 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde Jul 17 07:10:17 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:17 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bf9c3c3-deed-455b-ad00-4c6701256cde" returned: 0 in 0.267s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-4bf9c3c3-deed-455b-ad00-4c6701256cde" released by "delete_volume" :: held 0.850s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Created reservations ['9249cae0-b5fd-4ece-9160-0fd8bc4b7e72', 'fca01d90-5728-462a-a44d-e3c8707706a8', '5910b3d1-144f-4430-94f5-f7a8f241fd7d', '42ba9ae3-16ca-49f9-8ddb-e6f7a83c321f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:17 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:17 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-c0a3afc5-f004-47b9-9c39-4b9142957189-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-c0a3afc5-f004-47b9-9c39-4b9142957189-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Performing cascade delete. {{(pid=87331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-412d508e-97a6-4e38-8610-a8b234ab3ac5-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-412d508e-97a6-4e38-8610-a8b234ab3ac5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-412d508e-97a6-4e38-8610-a8b234ab3ac5" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-412d508e-97a6-4e38-8610-a8b234ab3ac5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Deleting offline snapshot 412d508e-97a6-4e38-8610-a8b234ab3ac5 of volume c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] snapshot_file for this snap is: volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcd84c0-c57a-4a8a-b174-3f1da3b71a20]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:18 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.431s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Deleted volume successfully. Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a0c377b-ad1f-4c0f-9ff9-d05cf246d572 tempest-VolumesActionsTest-65625 None] Lock "cinder-4bf9c3c3-deed-455b-ad00-4c6701256cde-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:18 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:18 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:18 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.558s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a3afc5-f004-47b9-9c39-4b9142957189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed5184-af44-4f1f-96a6-a8a1e4170e6d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (4ed2e892-42d1-4ef0-a9ca-07dcdb3833a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3528be7-df0c-4028-a2f5-a415b8c459fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3528be7-df0c-4028-a2f5-a415b8c459fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1122117866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e2b8f4-e4e8-4817-b72e-18c27405f134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:19Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:18 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:18 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426032ba-d3fc-486a-a633-cd4a4535e092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426032ba-d3fc-486a-a633-cd4a4535e092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741d6c23-6377-4c48-8e36-df6adf5d4949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741d6c23-6377-4c48-8e36-df6adf5d4949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e2b8f4-e4e8-4817-b72e-18c27405f134', 'volume_name': 'volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50b3fb0-d396-4273-8c64-ec038cceaa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50b3fb0-d396-4273-8c64-ec038cceaa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603a353e-880f-403d-9f2e-4c9f2a2571f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Volume b2e2b8f4-e4e8-4817-b72e-18c27405f134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134', 'volume_size': 1} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1122117866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e2b8f4-e4e8-4817-b72e-18c27405f134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:19Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Creating volume b2e2b8f4-e4e8-4817-b72e-18c27405f134 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:18 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:18 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 1073741824 Jul 17 07:10:18 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:19 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.526s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eff50e5-991c-42a6-820a-261b483ddee1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Flow 'volume_create_manager' (751676d6-436d-409d-969b-965750c66125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d238164-0045-4adc-9ea6-54ffe90226b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d238164-0045-4adc-9ea6-54ffe90226b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-126694886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1071bebf-4a1e-47e4-8f0c-e3013a784b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf2a5306ecc4f859729bdc867af9d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:19Z,use_quota=True,user_id='58212b5a555545669941ab5cbc5566b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6625a965-6fae-438b-a2c4-890514d6b477),volume_type_id=6625a965-6fae-438b-a2c4-890514d6b477)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 Jul 17 07:10:19 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a6c233-7723-4738-9f8f-e1c79be929cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a6c233-7723-4738-9f8f-e1c79be929cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4c15ba-00ac-4023-b334-bb9ef4a52a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4c15ba-00ac-4023-b334-bb9ef4a52a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1071bebf-4a1e-47e4-8f0c-e3013a784b2e', 'volume_name': 'volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe9f1bd-8ca9-42f3-b47f-d864fbede3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe9f1bd-8ca9-42f3-b47f-d864fbede3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dc0d33-3e9a-4d9d-82f6-b4d35d5648de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume 1071bebf-4a1e-47e4-8f0c-e3013a784b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e', 'volume_size': 1} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 1073741824" returned: 0 in 0.671s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:19 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 Jul 17 07:10:19 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Flow 'volume_create_manager' (aa57a65a-e5c1-41a8-af26-e186a9d1e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:19 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8d80aa-1bb0-4970-8788-f1e60e547a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227" returned: 0 in 0.518s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a3afc5-f004-47b9-9c39-4b9142957189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8d80aa-1bb0-4970-8788-f1e60e547a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1663252642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77710c45-73ef-4052-8ba2-c7130ce32d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf2a5306ecc4f859729bdc867af9d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:20Z,use_quota=True,user_id='58212b5a555545669941ab5cbc5566b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b2059ff-fe51-4fda-a089-491809cc5ab6),volume_type_id=9b2059ff-fe51-4fda-a089-491809cc5ab6)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ebff5c-651e-4be2-aeb4-85973ff39ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ebff5c-651e-4be2-aeb4-85973ff39ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f6ecd8-00d6-4964-9704-957c1120c892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f6ecd8-00d6-4964-9704-957c1120c892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77710c45-73ef-4052-8ba2-c7130ce32d73', 'volume_name': 'volume-77710c45-73ef-4052-8ba2-c7130ce32d73', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769dd463-238d-4c8b-b7f3-b04013fcccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769dd463-238d-4c8b-b7f3-b04013fcccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccac7067-be2b-48ce-a3ab-8659092b5bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume 77710c45-73ef-4052-8ba2-c7130ce32d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77710c45-73ef-4052-8ba2-c7130ce32d73', 'volume_size': 1} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e50ef-5680-4675-8477-ce5da8f759c0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:20 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134" returned: 0 in 0.361s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-126694886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1071bebf-4a1e-47e4-8f0c-e3013a784b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf2a5306ecc4f859729bdc867af9d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:19Z,use_quota=True,user_id='58212b5a555545669941ab5cbc5566b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6625a965-6fae-438b-a2c4-890514d6b477),volume_type_id=6625a965-6fae-438b-a2c4-890514d6b477)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Creating volume 1071bebf-4a1e-47e4-8f0c-e3013a784b2e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:20 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:20 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:20 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603a353e-880f-403d-9f2e-4c9f2a2571f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be09b1a3-4cb6-4df7-b8a8-0f2f3922e8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:20 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e 1073741824 Jul 17 07:10:20 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:20 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Volume volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 (b2e2b8f4-e4e8-4817-b72e-18c27405f134): created successfully Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be09b1a3-4cb6-4df7-b8a8-0f2f3922e8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (4ed2e892-42d1-4ef0-a9ca-07dcdb3833a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1cb86f68-e6d8-4b99-97e9-cc713981cb36 tempest-VolumesActionsTest-479036878 None] Created volume successfully. Jul 17 07:10:20 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.584s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a3afc5-f004-47b9-9c39-4b9142957189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb806d-2c2d-4ac4-8962-8e7544c84aaf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:20 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:20 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:20 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e 1073741824" returned: 0 in 0.650s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:20 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e Jul 17 07:10:20 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Flow 'volume_create_manager' (a1e8c200-c73c-4c23-807b-6d2fdc63d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ebc9e4-97b1-4991-ad99-58c9ac8bece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ebc9e4-97b1-4991-ad99-58c9ac8bece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1219129886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdeebd1-3558-48d2-964e-ab6c8a581e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf2a5306ecc4f859729bdc867af9d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:21Z,use_quota=True,user_id='58212b5a555545669941ab5cbc5566b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c404075-6f2c-4f67-8030-e49de8014e38),volume_type_id=2c404075-6f2c-4f67-8030-e49de8014e38)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9cd5d9-16d2-4669-a220-c37e73124086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9cd5d9-16d2-4669-a220-c37e73124086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a12974c-5659-4a2f-a7b3-b72fd5e54a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:10:21 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.501s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:21 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:21 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:21 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e" returned: 0 in 0.336s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1663252642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77710c45-73ef-4052-8ba2-c7130ce32d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf2a5306ecc4f859729bdc867af9d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:20Z,use_quota=True,user_id='58212b5a555545669941ab5cbc5566b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b2059ff-fe51-4fda-a089-491809cc5ab6),volume_type_id=9b2059ff-fe51-4fda-a089-491809cc5ab6)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Creating volume 77710c45-73ef-4052-8ba2-c7130ce32d73 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:21 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:21 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 1073741824 Jul 17 07:10:21 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dc0d33-3e9a-4d9d-82f6-b4d35d5648de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aaf51fb-c554-413d-b993-fbca6c90ab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-b2e2b8f4-e4e8-4817-b72e-18c27405f134-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:21 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e (1071bebf-4a1e-47e4-8f0c-e3013a784b2e): created successfully Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aaf51fb-c554-413d-b993-fbca6c90ab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Flow 'volume_create_manager' (751676d6-436d-409d-969b-965750c66125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7a1f2003-10ab-4a77-8666-2113e4800969 tempest-TestInstancesWithCinderVolumes-382292082 None] Created volume successfully. Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Lock "cinder-b2e2b8f4-e4e8-4817-b72e-18c27405f134-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Acquiring lock "cinder-quobyte-b2e2b8f4-e4e8-4817-b72e-18c27405f134" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-b2e2b8f4-e4e8-4817-b72e-18c27405f134" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05c0d5-f10c-4bb6-add8-7cdf1f81e893]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a12974c-5659-4a2f-a7b3-b72fd5e54a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2cdeebd1-3558-48d2-964e-ab6c8a581e68', 'volume_name': 'volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68', 'volume_size': 1, 'image_id': '60c531d4-d3f0-4493-a453-854a561dca64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60c531d4-d3f0-4493-a453-854a561dca64', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2121058970', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1bf2a5306ecc4f859729bdc867af9d2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60c531d4-d3f0-4493-a453-854a561dca64', 'created_at': datetime.datetime(2026, 7, 17, 5, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 10, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60c531d4-d3f0-4493-a453-854a561dca64/file', 'properties': {}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2a7f57-3d05-4134-bc3e-042ad71660c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2a7f57-3d05-4134-bc3e-042ad71660c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f5d27d-8c24-4129-9505-8ff0eaf8b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:21 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume 2cdeebd1-3558-48d2-964e-ab6c8a581e68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68', 'volume_size': 1, 'image_id': '60c531d4-d3f0-4493-a453-854a561dca64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60c531d4-d3f0-4493-a453-854a561dca64', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2121058970', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1bf2a5306ecc4f859729bdc867af9d2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60c531d4-d3f0-4493-a453-854a561dca64', 'created_at': datetime.datetime(2026, 7, 17, 5, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 10, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60c531d4-d3f0-4493-a453-854a561dca64/file', 'properties': {}}, 'image_service': } Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Trying to clone 2cdeebd1-3558-48d2-964e-ab6c8a581e68 from image 60c531d4-d3f0-4493-a453-854a561dca64 at location (None, [{'url': 'file:///opt/stack/data/glance/images/60c531d4-d3f0-4493-a453-854a561dca64', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:10:21 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.583s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:21 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 Jul 17 07:10:21 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:21 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5 Jul 17 07:10:21 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:21 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 1073741824" returned: 0 in 0.675s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:21 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 Jul 17 07:10:21 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:22 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134" returned: 0 in 0.549s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:22 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.412d508e-97a6-4e38-8610-a8b234ab3ac5" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 -F qcow2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:22 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134 Jul 17 07:10:22 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:22 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 -F qcow2 Jul 17 07:10:22 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:22 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73" returned: 0 in 0.363s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccac7067-be2b-48ce-a3ab-8659092b5bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77710c45-73ef-4052-8ba2-c7130ce32d73', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8023ed24-1796-4a92-9891-9e7c3364ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:22 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume volume-77710c45-73ef-4052-8ba2-c7130ce32d73 (77710c45-73ef-4052-8ba2-c7130ce32d73): created successfully Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8023ed24-1796-4a92-9891-9e7c3364ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Flow 'volume_create_manager' (aa57a65a-e5c1-41a8-af26-e186a9d1e207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7c4282b3-9e19-4116-a30e-3d94276e2411 tempest-TestInstancesWithCinderVolumes-382292082 None] Created volume successfully. Jul 17 07:10:22 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b2e2b8f4-e4e8-4817-b72e-18c27405f134" returned: 0 in 0.377s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Lock "cinder-quobyte-b2e2b8f4-e4e8-4817-b72e-18c27405f134" released by "delete_volume" :: held 0.984s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Created reservations ['b8fcbab3-900b-430b-9077-5586aae9e928', '1c0e8057-3520-487d-b0d5-5013ce1a76df', 'b0d7b6cf-bc8e-4bd8-82ac-bd901af6ddce', 'f5f496b6-aedc-4f57-a3a3-ebb6d969e552'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:22 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a3afc5-f004-47b9-9c39-4b9142957189 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 -F qcow2" returned: 0 in 0.472s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-412d508e-97a6-4e38-8610-a8b234ab3ac5" released by "_delete_snapshot" :: held 4.502s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" released by "delete_snapshot" :: held 4.537s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:22 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:22 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Created reservations ['079edda4-5990-48c6-aeea-860bc3eebde7', '5dd04dbe-dd58-46fa-adb2-dba3adfcaba9', '16eaff12-fb76-47c0-a7d4-ef6ca5cd6f42', '6a857720-6352-4747-af69-8176c1db5900'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Delete snapshot completed successfully. Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-412d508e-97a6-4e38-8610-a8b234ab3ac5-delete_snapshot" released by "delete_snapshot" :: held 4.816s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-bc53fb9b-156b-429f-8902-b2adef84f227-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-bc53fb9b-156b-429f-8902-b2adef84f227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-bc53fb9b-156b-429f-8902-b2adef84f227" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-bc53fb9b-156b-429f-8902-b2adef84f227" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Deleting offline snapshot bc53fb9b-156b-429f-8902-b2adef84f227 of volume c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] snapshot_file for this snap is: volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[edabd1ad-cfc6-43f2-a2d0-ffc359c4bff6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:23 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.394s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Deleted volume successfully. Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c87ab0bd-bb29-422b-97ff-8a7a59793b5b tempest-VolumesActionsTest-65625 None] Lock "cinder-b2e2b8f4-e4e8-4817-b72e-18c27405f134-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:23 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 Jul 17 07:10:23 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:23 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227" returned: 0 in 0.485s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a3afc5-f004-47b9-9c39-4b9142957189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c43e91-65f7-4e72-99c9-344dffd1663e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:23 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:23 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:24 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.608s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:24 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 Jul 17 07:10:24 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (d9bdcf04-cc78-44fd-ba27-4af3f9cdedb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f893b54c-0d5e-4aa0-8010-585f68aac58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f893b54c-0d5e-4aa0-8010-585f68aac58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-42271599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcdb200-aac2-4d7c-9f29-80022dd80e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:24Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e228b6a6-1c56-4b90-809b-d16c7b5f8f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e228b6a6-1c56-4b90-809b-d16c7b5f8f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7c9a01-0e67-4cf9-bc17-8b2e906ebda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7c9a01-0e67-4cf9-bc17-8b2e906ebda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcdb200-aac2-4d7c-9f29-80022dd80e75', 'volume_name': 'volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e265f90-4338-4c6c-8545-cd7d9c07371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e265f90-4338-4c6c-8545-cd7d9c07371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5f91e7-1e67-4d6e-b9df-1cce43b83951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:24 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Volume 3bcdb200-aac2-4d7c-9f29-80022dd80e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75', 'volume_size': 1} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-42271599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcdb200-aac2-4d7c-9f29-80022dd80e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791e98028bf34c0a83e5d404c1d2107d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:24Z,use_quota=True,user_id='4a41736329254536b966206f7923353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Creating volume 3bcdb200-aac2-4d7c-9f29-80022dd80e75 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:24 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:24 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 1073741824 Jul 17 07:10:24 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:24 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227" returned: 0 in 0.536s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:24 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227 Jul 17 07:10:24 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:24 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189.bc53fb9b-156b-429f-8902-b2adef84f227" returned: 0 in 0.332s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-bc53fb9b-156b-429f-8902-b2adef84f227" released by "_delete_snapshot" :: held 2.105s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" released by "delete_snapshot" :: held 2.140s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:25 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 1073741824" returned: 0 in 0.551s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Created reservations ['97ec374b-b91b-4a55-95ed-48e32c9756d6', '2d82af0b-cda3-4305-ba69-9d025f11cb5d', 'fdeec227-494b-47d4-b875-3bf2c6eea3e6', '9425e3e1-9741-488b-a521-01127c98c6ed'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:25 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 Jul 17 07:10:25 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Delete snapshot completed successfully. Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-bc53fb9b-156b-429f-8902-b2adef84f227-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Snapshots deleted, issuing volume delete {{(pid=87331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b3254-95e9-4a24-ba6c-b03fc4a6187f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:25 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75" returned: 0 in 0.333s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:25 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:25 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5f91e7-1e67-4d6e-b9df-1cce43b83951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5889835b-6391-445c-8e0f-612a94a05f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:25 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Volume volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 (3bcdb200-aac2-4d7c-9f29-80022dd80e75): created successfully Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5889835b-6391-445c-8e0f-612a94a05f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Flow 'volume_create_manager' (d9bdcf04-cc78-44fd-ba27-4af3f9cdedb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bc590037-632d-40a9-b70b-5b3f7d8711b2 tempest-VolumesActionsTest-479036878 None] Created volume successfully. Jul 17 07:10:25 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.475s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:25 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189 Jul 17 07:10:25 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:26 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c0a3afc5-f004-47b9-9c39-4b9142957189" returned: 0 in 0.324s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-c0a3afc5-f004-47b9-9c39-4b9142957189" released by "delete_volume" :: held 0.878s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Created reservations ['76426700-b023-42b5-98d4-3cd1bd8535d6', 'e0f95aab-b8fe-46e9-86a8-6b5d5d67b97a', 'c7b554d6-7c32-4a35-b5e5-8d8758c7de9a', 'ea1b6b86-52a2-4a01-bd52-559e41fc457e'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:26 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:26 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:26 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Deleted volume successfully. Jul 17 07:10:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e798c9cb-d435-4fd9-bcb9-56b17bdb8795 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-c0a3afc5-f004-47b9-9c39-4b9142957189-delete_volume" released by "delete_volume" :: held 8.735s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Acquiring lock "cinder-3bcdb200-aac2-4d7c-9f29-80022dd80e75-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Lock "cinder-3bcdb200-aac2-4d7c-9f29-80022dd80e75-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Acquiring lock "cinder-quobyte-3bcdb200-aac2-4d7c-9f29-80022dd80e75" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Lock "cinder-quobyte-3bcdb200-aac2-4d7c-9f29-80022dd80e75" acquired by "delete_volume" :: waited 0.039s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5dc617-0ed9-4d26-956a-9769ffb01950]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD, size 20.69 MB, duration 5.81 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:10:27 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Image download 20.69 MB at 3.56 MB/s Jul 17 07:10:27 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 Jul 17 07:10:27 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2af1e59-9d0f-41e8-a315-59e00b257a7b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:27 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD Jul 17 07:10:27 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Flow 'volume_create_manager' (9f2a05f5-8ce9-463a-ab1b-e9d3312e2afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cf950c-cd01-4afe-9dff-a7a4245fe725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cf950c-cd01-4afe-9dff-a7a4245fe725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-925028263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f45c75-0ed9-49cb-b1b2-53562ad333fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed27b6bcd5046aaa17741aebb373708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:28Z,use_quota=True,user_id='5aa05a1b00364a109b4f8dbdce574256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a43bba2-4979-4b70-966d-2db5a9cc0212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a43bba2-4979-4b70-966d-2db5a9cc0212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cfc218-3f04-471a-8010-ca7bf9edd33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cfc218-3f04-471a-8010-ca7bf9edd33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f45c75-0ed9-49cb-b1b2-53562ad333fd', 'volume_name': 'volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fa968c-0e3c-4fe0-b3fe-970657e3066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fa968c-0e3c-4fe0-b3fe-970657e3066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b14a3c-2a23-4c08-bebb-8f0869655626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:27 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Volume 67f45c75-0ed9-49cb-b1b2-53562ad333fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd', 'volume_size': 1} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-925028263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f45c75-0ed9-49cb-b1b2-53562ad333fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed27b6bcd5046aaa17741aebb373708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:28Z,use_quota=True,user_id='5aa05a1b00364a109b4f8dbdce574256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Creating volume 67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:27 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:27 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd 1073741824 Jul 17 07:10:27 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:27 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75" returned: 0 in 0.560s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:27 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75 Jul 17 07:10:27 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:27 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Temporary image 60c531d4-d3f0-4493-a453-854a561dca64 is fetched for user 58212b5a555545669941ab5cbc5566b4. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a218f-1470-48f5-8fb7-74f8d08a7530]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:28 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD Jul 17 07:10:28 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:28 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3bcdb200-aac2-4d7c-9f29-80022dd80e75" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Lock "cinder-quobyte-3bcdb200-aac2-4d7c-9f29-80022dd80e75" released by "delete_volume" :: held 0.940s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Created reservations ['c8b3ef83-cee4-4580-989f-b0e94ae88f23', 'ac3a1837-882a-4e48-ab9b-cd42352f7473', '9d1c1a8a-1c00-4632-9452-a67d930c8b0b', '1aabb47f-2085-4de3-a0cc-870b63cf8ed4'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:28 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd 1073741824" returned: 0 in 0.611s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:28 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:28 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:28 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:28 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:28 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:28 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:28 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Deleted volume successfully. Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.289s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1219129886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdeebd1-3558-48d2-964e-ab6c8a581e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf2a5306ecc4f859729bdc867af9d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:21Z,use_quota=True,user_id='58212b5a555545669941ab5cbc5566b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c404075-6f2c-4f67-8030-e49de8014e38),volume_type_id=2c404075-6f2c-4f67-8030-e49de8014e38)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Creating volume 2cdeebd1-3558-48d2-964e-ab6c8a581e68 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:28 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:28 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 1073741824 Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b14a3c-2a23-4c08-bebb-8f0869655626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:28 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb699489-57f2-4a98-a877-f09fbece2af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48bfffae-0c37-4caa-9943-101b2e3aa6d9 tempest-VolumesActionsTest-479036878 None] Lock "cinder-3bcdb200-aac2-4d7c-9f29-80022dd80e75-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Volume volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd (67f45c75-0ed9-49cb-b1b2-53562ad333fd): created successfully Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb699489-57f2-4a98-a877-f09fbece2af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Flow 'volume_create_manager' (9f2a05f5-8ce9-463a-ab1b-e9d3312e2afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6bc1cbc4-f6ff-4770-bcf1-2009f2f9300a tempest-VolumesDeleteCascade-1863480830 None] Created volume successfully. Jul 17 07:10:29 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 1073741824" returned: 0 in 0.461s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:29 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 Jul 17 07:10:29 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:29 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68" returned: 0 in 0.271s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Attempting download of 60c531d4-d3f0-4493-a453-854a561dca64 ((None, [{'url': 'file:///opt/stack/data/glance/images/60c531d4-d3f0-4493-a453-854a561dca64', 'metadata': {}}])) to volume 2cdeebd1-3558-48d2-964e-ab6c8a581e68. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63608f6-5521-4d56-aeba-9e433a60bb18]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:29 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0 Jul 17 07:10:29 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:29 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:29 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Creating offline snapshot 99533ca4-6179-4b90-9069-b0036fd2ef68 of volume 67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:10:30 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0" returned: 0 in 0.584s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a2c6f-a0cc-46f1-bc8b-82d7f6558483]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:30 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:30 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0 Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:30 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:10:30 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:30 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:30 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0" returned: 1 in 0.453s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60c531d4-d3f0-4493-a453-854a561dca64_qlxoimv0' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ffc556-f73a-4b61-aed8-1698bb567644]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:30 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.542s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:30 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD Jul 17 07:10:30 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:30 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 1G Jul 17 07:10:30 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:30 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] 60c531d4-d3f0-4493-a453-854a561dca64 was qcow2, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:10:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:31 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 Jul 17 07:10:31 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:31 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 1G" returned: 0 in 0.638s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:31 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 Jul 17 07:10:31 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:31 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68" returned: 0 in 0.415s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:31 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 is being set with open permissions: ugo+rw Jul 17 07:10:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:31 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 Jul 17 07:10:31 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:32 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68" returned: 0 in 0.389s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:32 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info Jul 17 07:10:32 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:32 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:32 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info is being set with open permissions: ugo+rw Jul 17 07:10:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:32 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info Jul 17 07:10:32 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:32 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.info" returned: 0 in 0.398s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6256a07a-8cbc-4ac6-90e8-e93e17cd18ab tempest-VolumesDeleteCascade-1863480830 None] Create snapshot completed successfully Jul 17 07:10:33 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68" returned: 0 in 2.359s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60c531d4-d3f0-4493-a453-854a561dca64_nrg0cfordevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:10:33 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Converted 112.00 MB image at 47.45 MB/s Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:33 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 1G Jul 17 07:10:33 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:33 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 1G" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Downloaded image 60c531d4-d3f0-4493-a453-854a561dca64 ((None, [{'url': 'file:///opt/stack/data/glance/images/60c531d4-d3f0-4493-a453-854a561dca64', 'metadata': {}}])) to volume 2cdeebd1-3558-48d2-964e-ab6c8a581e68 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Temporary image 60c531d4-d3f0-4493-a453-854a561dca64 for user 58212b5a555545669941ab5cbc5566b4 is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Marking volume 2cdeebd1-3558-48d2-964e-ab6c8a581e68 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Copying metadata from image 60c531d4-d3f0-4493-a453-854a561dca64 to 2cdeebd1-3558-48d2-964e-ab6c8a581e68. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Creating volume glance metadata for volume 2cdeebd1-3558-48d2-964e-ab6c8a581e68 backed by image 60c531d4-d3f0-4493-a453-854a561dca64 with: {'image_id': '60c531d4-d3f0-4493-a453-854a561dca64', 'image_name': 'tempest-scenario-img--2121058970', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f5d27d-8c24-4129-9505-8ff0eaf8b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68', 'volume_size': 1, 'image_id': '60c531d4-d3f0-4493-a453-854a561dca64', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60c531d4-d3f0-4493-a453-854a561dca64', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2121058970', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1bf2a5306ecc4f859729bdc867af9d2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60c531d4-d3f0-4493-a453-854a561dca64', 'created_at': datetime.datetime(2026, 7, 17, 5, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 10, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60c531d4-d3f0-4493-a453-854a561dca64/file', 'properties': {}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634e0b69-8664-42c3-8a53-474dbfc78ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:33 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Volume volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 (2cdeebd1-3558-48d2-964e-ab6c8a581e68): created successfully Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634e0b69-8664-42c3-8a53-474dbfc78ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Flow 'volume_create_manager' (a1e8c200-c73c-4c23-807b-6d2fdc63d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-44c38a2d-9d7c-4c3e-b316-39b228a57f96 tempest-TestInstancesWithCinderVolumes-382292082 None] Created volume successfully. Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Flow 'volume_create_manager' (73ee30b9-8480-4258-935b-6d777b0cb288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4486be-3a5a-40a6-8959-7be7e0eaa0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4486be-3a5a-40a6-8959-7be7e0eaa0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2065343556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af59eb8a-5280-465c-87a7-08f092394632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed27b6bcd5046aaa17741aebb373708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99533ca4-6179-4b90-9069-b0036fd2ef68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:34Z,use_quota=True,user_id='5aa05a1b00364a109b4f8dbdce574256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c338b60-f4bd-4510-a92b-38d214bfa1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c338b60-f4bd-4510-a92b-38d214bfa1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fb2715-f779-402e-9949-6bddb6c1d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fb2715-f779-402e-9949-6bddb6c1d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af59eb8a-5280-465c-87a7-08f092394632', 'volume_name': 'volume-af59eb8a-5280-465c-87a7-08f092394632', 'volume_size': 1, 'snapshot_id': '99533ca4-6179-4b90-9069-b0036fd2ef68'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90042638-b125-4e2d-885e-c204d46900e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90042638-b125-4e2d-885e-c204d46900e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba20087-bc7f-43f6-8b35-58410fe5d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Volume af59eb8a-5280-465c-87a7-08f092394632: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af59eb8a-5280-465c-87a7-08f092394632', 'volume_size': 1, 'snapshot_id': '99533ca4-6179-4b90-9069-b0036fd2ef68'} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-99533ca4-6179-4b90-9069-b0036fd2ef68-af59eb8a-5280-465c-87a7-08f092394632" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-99533ca4-6179-4b90-9069-b0036fd2ef68-af59eb8a-5280-465c-87a7-08f092394632" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Creating volume af59eb8a-5280-465c-87a7-08f092394632 from snapshot 99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-af59eb8a-5280-465c-87a7-08f092394632" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-af59eb8a-5280-465c-87a7-08f092394632" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] snapshot: 99533ca4-6179-4b90-9069-b0036fd2ef68, volume: af59eb8a-5280-465c-87a7-08f092394632, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c700816-ea75-4379-a995-49aa422334c9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:34 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 Jul 17 07:10:34 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:34 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68" returned: 0 in 0.510s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff928ed8-a8e0-4f59-9156-f31eee777285]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:35 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:35 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:35 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.669s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:35 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:10:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:35 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 Jul 17 07:10:35 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Flow 'volume_create_manager' (ffb5d61a-0173-45f0-8623-6938454bb53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107cb7eb-b9d7-4ca8-87a5-3478d8976c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107cb7eb-b9d7-4ca8-87a5-3478d8976c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1854454628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccdbe37-b8fd-4757-bbab-52f7d98849e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628bfe4e0929412cb869877699d53158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:37Z,use_quota=True,user_id='8e9f998a470349f090e16b9f79c3dc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b511a492-9476-4a59-89d5-acb1671b76b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b511a492-9476-4a59-89d5-acb1671b76b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4e13d4-ad93-4a5d-894e-b126249ce100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4e13d4-ad93-4a5d-894e-b126249ce100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccdbe37-b8fd-4757-bbab-52f7d98849e3', 'volume_name': 'volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0befe432-fc39-474d-b1cb-f6d6429ac9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0befe432-fc39-474d-b1cb-f6d6429ac9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f958bfe-7171-4c48-b184-3f20b611f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:37 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Volume 2ccdbe37-b8fd-4757-bbab-52f7d98849e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3', 'volume_size': 1} Jul 17 07:10:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Flow 'volume_create_manager' (5b619736-7f7d-4157-a602-5dc3cb6c7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348eb5a7-4ed7-4b88-b824-acb5c8aa3cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348eb5a7-4ed7-4b88-b824-acb5c8aa3cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1103121413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8da5753-4585-4733-9ec1-10431d415f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628bfe4e0929412cb869877699d53158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:39Z,use_quota=True,user_id='8e9f998a470349f090e16b9f79c3dc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2041678-8bbe-4157-81e9-d626a1f4e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2041678-8bbe-4157-81e9-d626a1f4e530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c63902-5e09-43c8-909a-cbfd0ba51a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c63902-5e09-43c8-909a-cbfd0ba51a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8da5753-4585-4733-9ec1-10431d415f13', 'volume_name': 'volume-d8da5753-4585-4733-9ec1-10431d415f13', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32f661c-43e9-4e43-8272-3d3bcd6d1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32f661c-43e9-4e43-8272-3d3bcd6d1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2476cfdc-737b-4490-b46c-0d6a9c179075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Volume d8da5753-4585-4733-9ec1-10431d415f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8da5753-4585-4733-9ec1-10431d415f13', 'volume_size': 1} Jul 17 07:10:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-43b249dd-a576-4496-b543-bad95ea72881 req-e12076be-ecd5-4780-9ed4-fe39dd3d72a1 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:42 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632" returned: 0 in 6.563s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:42 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfac4fa-c923-462c-892e-6bbf993e059c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:42 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:42 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:42 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.638s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:42 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:10:42 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Converted 1024.00 MB image at 155.97 MB/s Jul 17 07:10:42 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 is being set with open permissions: ugo+rw Jul 17 07:10:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:42 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 Jul 17 07:10:42 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:43 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632" returned: 0 in 0.266s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-af59eb8a-5280-465c-87a7-08f092394632" released by "_copy_volume_from_snapshot" :: held 8.801s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-99533ca4-6179-4b90-9069-b0036fd2ef68-af59eb8a-5280-465c-87a7-08f092394632" released by "_create_volume_from_snapshot" :: held 8.844s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.864s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.182s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1854454628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccdbe37-b8fd-4757-bbab-52f7d98849e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628bfe4e0929412cb869877699d53158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:37Z,use_quota=True,user_id='8e9f998a470349f090e16b9f79c3dc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Creating volume 2ccdbe37-b8fd-4757-bbab-52f7d98849e3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:43 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 1073741824 Jul 17 07:10:43 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba20087-bc7f-43f6-8b35-58410fe5d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af59eb8a-5280-465c-87a7-08f092394632', 'volume_size': 1, 'snapshot_id': '99533ca4-6179-4b90-9069-b0036fd2ef68'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa0e89c-0156-46bf-8d35-85e8f5830f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Volume volume-af59eb8a-5280-465c-87a7-08f092394632 (af59eb8a-5280-465c-87a7-08f092394632): created successfully Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa0e89c-0156-46bf-8d35-85e8f5830f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Flow 'volume_create_manager' (73ee30b9-8480-4258-935b-6d777b0cb288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f6645086-c660-4804-8635-6d1b0ae153ad tempest-VolumesDeleteCascade-1863480830 None] Created volume successfully. Jul 17 07:10:43 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 1073741824" returned: 0 in 0.556s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:43 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 Jul 17 07:10:43 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:43 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1103121413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8da5753-4585-4733-9ec1-10431d415f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628bfe4e0929412cb869877699d53158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:10:39Z,use_quota=True,user_id='8e9f998a470349f090e16b9f79c3dc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Creating volume d8da5753-4585-4733-9ec1-10431d415f13 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:10:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:10:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:44 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 1073741824 Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f958bfe-7171-4c48-b184-3f20b611f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:44 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1b05b6-644e-48e2-ba36-c2c033605fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Volume volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 (2ccdbe37-b8fd-4757-bbab-52f7d98849e3): created successfully Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1b05b6-644e-48e2-ba36-c2c033605fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Flow 'volume_create_manager' (ffb5d61a-0173-45f0-8623-6938454bb53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d536fce2-2471-41b3-9054-fe308c5f59a1 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Created volume successfully. Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-67f45c75-0ed9-49cb-b1b2-53562ad333fd-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-67f45c75-0ed9-49cb-b1b2-53562ad333fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:44 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 1073741824" returned: 0 in 0.672s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Performing cascade delete. {{(pid=87331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-99533ca4-6179-4b90-9069-b0036fd2ef68-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-99533ca4-6179-4b90-9069-b0036fd2ef68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-67f45c75-0ed9-49cb-b1b2-53562ad333fd" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:44 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 Jul 17 07:10:44 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-67f45c75-0ed9-49cb-b1b2-53562ad333fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-99533ca4-6179-4b90-9069-b0036fd2ef68" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-99533ca4-6179-4b90-9069-b0036fd2ef68" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Deleting offline snapshot 99533ca4-6179-4b90-9069-b0036fd2ef68 of volume 67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] snapshot_file for this snap is: volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bac08b-b574-45c0-b824-abe00acc9e36]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:44 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 Jul 17 07:10:44 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:45 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13" returned: 0 in 0.348s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-43b249dd-a576-4496-b543-bad95ea72881 req-e12076be-ecd5-4780-9ed4-fe39dd3d72a1 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.809s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2476cfdc-737b-4490-b46c-0d6a9c179075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8da5753-4585-4733-9ec1-10431d415f13', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86a5961-233d-4ce9-b93b-36be7c8e8c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:10:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Volume volume-d8da5753-4585-4733-9ec1-10431d415f13 (d8da5753-4585-4733-9ec1-10431d415f13): created successfully Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86a5961-233d-4ce9-b93b-36be7c8e8c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Flow 'volume_create_manager' (5b619736-7f7d-4157-a602-5dc3cb6c7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-43b249dd-a576-4496-b543-bad95ea72881 req-e12076be-ecd5-4780-9ed4-fe39dd3d72a1 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.101s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-800581e1-de4b-4a79-8c5a-592acc152f71 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Created volume successfully. Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-43b249dd-a576-4496-b543-bad95ea72881 req-e12076be-ecd5-4780-9ed4-fe39dd3d72a1 tempest-TestInstancesWithCinderVolumes-382292082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60fc11b7-a48a-49eb-a447-d16615dfbcb3', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:10:45 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68" returned: 0 in 0.548s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:10:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-43b249dd-a576-4496-b543-bad95ea72881 req-e12076be-ecd5-4780-9ed4-fe39dd3d72a1 tempest-TestInstancesWithCinderVolumes-382292082 None] attachment_update completed successfully. Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7b95a-5b72-4f7e-bfb3-bb12f01391b8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:45 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:45 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:46 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.675s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:46 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 Jul 17 07:10:46 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:46 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68" returned: 0 in 0.622s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:46 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68 Jul 17 07:10:46 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:47 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd.99533ca4-6179-4b90-9069-b0036fd2ef68" returned: 0 in 0.502s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-99533ca4-6179-4b90-9069-b0036fd2ef68" released by "_delete_snapshot" :: held 2.542s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-67f45c75-0ed9-49cb-b1b2-53562ad333fd" released by "delete_snapshot" :: held 2.585s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Created reservations ['b24b90ea-e813-45ed-8bce-fe4badf4254f', '65e75207-5c75-4f5c-83af-9947bfa9a5b8', '609ef485-9896-4b68-9575-efc04dbb11a7', 'c84637a6-66e3-484f-b4f6-d356bc6abf5e'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Delete snapshot completed successfully. Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-99533ca4-6179-4b90-9069-b0036fd2ef68-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Snapshots deleted, issuing volume delete {{(pid=87331) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-67f45c75-0ed9-49cb-b1b2-53562ad333fd" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-67f45c75-0ed9-49cb-b1b2-53562ad333fd" acquired by "delete_volume" :: waited 0.051s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c250bec-9bf7-466a-b9e4-0a4502132579]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:48 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:48 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:48 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.701s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:48 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd Jul 17 07:10:48 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:49 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-67f45c75-0ed9-49cb-b1b2-53562ad333fd" returned: 0 in 0.674s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-67f45c75-0ed9-49cb-b1b2-53562ad333fd" released by "delete_volume" :: held 1.594s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Created reservations ['6800b6e0-db09-4f11-976c-e8fc52993bc5', 'c0390d82-533d-4874-a4f1-785540eeff17', '49a84dac-2e21-4bcd-bd52-f607f892a819', 'c4e7d720-890f-427b-8973-5a6e572cc630'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:49 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:49 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:50 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.384s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:50 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Deleted volume successfully. Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eb99d0a6-733a-43ac-abfa-ede54b09d407 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-67f45c75-0ed9-49cb-b1b2-53562ad333fd-delete_volume" released by "delete_volume" :: held 5.598s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-af59eb8a-5280-465c-87a7-08f092394632-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-af59eb8a-5280-465c-87a7-08f092394632-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "cinder-quobyte-af59eb8a-5280-465c-87a7-08f092394632" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-af59eb8a-5280-465c-87a7-08f092394632" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45212b-e2de-4fb4-9197-27e907161a06]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:10:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:50 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 Jul 17 07:10:50 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:51 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632" returned: 0 in 0.607s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:51 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632 Jul 17 07:10:51 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:51 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-af59eb8a-5280-465c-87a7-08f092394632" returned: 0 in 0.399s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-quobyte-af59eb8a-5280-465c-87a7-08f092394632" released by "delete_volume" :: held 1.058s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Created reservations ['aa33e8d2-4ae6-4979-964f-7c67761357e7', '1d697975-2792-4c6c-ac38-1b8a65671da1', '8219da7e-0847-4fe0-b9da-e117d9f9accd', '4780ecf8-e732-434c-a97b-a28f955166c9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:10:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:10:51 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:10:51 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:10:52 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 17 07:10:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.555s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:10:52 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:10:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Deleted volume successfully. Jul 17 07:10:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c7af9c60-a842-4bc7-af77-034722cd5bb4 tempest-VolumesDeleteCascade-1863480830 None] Lock "cinder-af59eb8a-5280-465c-87a7-08f092394632-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Flow 'volume_create_manager' (268c6856-5364-4e53-a49c-dd7fef33546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49373e64-6671-481e-8c9c-718c36e86e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49373e64-6671-481e-8c9c-718c36e86e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-695389730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5f0672-0633-49bf-a5fe-03fee00fd87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bd715b41b44285bd91ecfa4c1ca7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:01Z,use_quota=True,user_id='e307cadcf26d45c4a5ca23d83c83ab8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285ff450-9021-4a08-b52a-d9ccbf6f62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285ff450-9021-4a08-b52a-d9ccbf6f62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afbbce9-a590-499b-bb1a-a79c7f48dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afbbce9-a590-499b-bb1a-a79c7f48dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5f0672-0633-49bf-a5fe-03fee00fd87c', 'volume_name': 'volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e9448a-e274-48e2-8208-d4f718291ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e9448a-e274-48e2-8208-d4f718291ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4076c5-dea0-497e-bd11-e13e92763ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:00 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Volume bd5f0672-0633-49bf-a5fe-03fee00fd87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c', 'volume_size': 1} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-695389730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5f0672-0633-49bf-a5fe-03fee00fd87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bd715b41b44285bd91ecfa4c1ca7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:01Z,use_quota=True,user_id='e307cadcf26d45c4a5ca23d83c83ab8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Creating volume bd5f0672-0633-49bf-a5fe-03fee00fd87c {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:00 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:00 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c 1073741824 Jul 17 07:11:00 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:01 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c 1073741824" returned: 0 in 0.989s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:02 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c Jul 17 07:11:02 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:02 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c" returned: 0 in 0.559s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4076c5-dea0-497e-bd11-e13e92763ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ef65c9-47d6-4177-acd3-06bc29fb44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:02 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Volume volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c (bd5f0672-0633-49bf-a5fe-03fee00fd87c): created successfully Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ef65c9-47d6-4177-acd3-06bc29fb44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Flow 'volume_create_manager' (268c6856-5364-4e53-a49c-dd7fef33546f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:02 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e3d8716c-fd0f-4481-b4a1-3a741f02aff3 tempest-VolumesMetadataTest-1315586871 None] Created volume successfully. Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Flow 'volume_create_manager' (b7b6714f-127c-4d80-83c3-e0dcb888e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fdf8a1-2efd-4506-9c30-a739207e25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=110,cinder:UPDATE=131,cinder:INSERT=39,cinder:DELETE=7 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fdf8a1-2efd-4506-9c30-a739207e25db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2015916475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc1f9f0-af41-4b17-8b58-b7d26ea618d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4a672ed9134953911d867afe1096ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:05Z,use_quota=True,user_id='ceeef5bafe65400b833f00478d1b1caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c100a0-7e3c-4560-ae6f-a43cce6accba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c100a0-7e3c-4560-ae6f-a43cce6accba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820ccf49-66c0-4d9b-8a68-8691a26fb283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Acquiring lock "cinder-bd5f0672-0633-49bf-a5fe-03fee00fd87c-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Lock "cinder-bd5f0672-0633-49bf-a5fe-03fee00fd87c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=128,cinder:INSERT=29,cinder:DELETE=18,cinder:SELECT=104 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Acquiring lock "cinder-quobyte-bd5f0672-0633-49bf-a5fe-03fee00fd87c" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Lock "cinder-quobyte-bd5f0672-0633-49bf-a5fe-03fee00fd87c" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66872b-978c-4b60-9a47-cdf60583125a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820ccf49-66c0-4d9b-8a68-8691a26fb283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dcc1f9f0-af41-4b17-8b58-b7d26ea618d7', 'volume_name': 'volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4e2d0c-fe46-4126-9647-e676dd06c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4e2d0c-fe46-4126-9647-e676dd06c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:05 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c Jul 17 07:11:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cef36a-0054-416e-bf31-e26318bb6f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:05 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Volume dcc1f9f0-af41-4b17-8b58-b7d26ea618d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 07:11:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Trying to clone dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 from image d615f633-2881-4d59-aa2e-ff4db61859d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:11:05 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:11:05 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Image download 20.69 MB at 20.69 MB/s Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1a5853-f477-403b-9635-f835ba4afd7c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:06 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c" returned: 0 in 1.095s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:06 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c Jul 17 07:11:06 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:06 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD Jul 17 07:11:06 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:06 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 is fetched for user ceeef5bafe65400b833f00478d1b1caf. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:11:06 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bd5f0672-0633-49bf-a5fe-03fee00fd87c" returned: 0 in 0.496s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Lock "cinder-quobyte-bd5f0672-0633-49bf-a5fe-03fee00fd87c" released by "delete_volume" :: held 1.699s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419d679-38d4-442f-80cf-a9f31ecd2694]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Created reservations ['5e9caaef-0078-42f6-a7f2-b508eaee8bd4', 'ba8ee92d-27b9-4a40-a9d3-b30f6fd46a87', '2db20053-29b6-4d41-8feb-3b106d2c8548', 'b06ece32-edc3-405c-8132-eec2caba65b2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:06 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD Jul 17 07:11:06 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:06 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:06 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:07 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.342s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:07 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Deleted volume successfully. Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2015916475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc1f9f0-af41-4b17-8b58-b7d26ea618d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4a672ed9134953911d867afe1096ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:05Z,use_quota=True,user_id='ceeef5bafe65400b833f00478d1b1caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Creating volume dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:07 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:07 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 1073741824 Jul 17 07:11:07 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0156f5d3-9933-4ed7-822e-6721ebdd705c tempest-VolumesMetadataTest-1315586871 None] Lock "cinder-bd5f0672-0633-49bf-a5fe-03fee00fd87c-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:07 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 1073741824" returned: 0 in 0.640s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:07 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 Jul 17 07:11:07 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:08 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Attempting download of d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume dcc1f9f0-af41-4b17-8b58-b7d26ea618d7. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa873b6-2a1a-477e-93e5-8213165946c7]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:08 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg Jul 17 07:11:08 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:08 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg" returned: 0 in 0.442s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:08 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg Jul 17 07:11:08 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:09 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg" returned: 1 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_xiy2xngg' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef3264-8ea2-429b-9f6c-ea6eded6024e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:09 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD Jul 17 07:11:09 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:09 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] d615f633-2881-4d59-aa2e-ff4db61859d1 was qcow2, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:11:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:09 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 Jul 17 07:11:09 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:11 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" returned: 0 in 1.866s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_cbrl5z6edevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:11:11 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Converted 112.00 MB image at 59.98 MB/s Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:11 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 1G Jul 17 07:11:11 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:11 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 1G" returned: 0 in 0.330s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Downloaded image d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 for user ceeef5bafe65400b833f00478d1b1caf is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Marking volume dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Copying metadata from image d615f633-2881-4d59-aa2e-ff4db61859d1 to dcc1f9f0-af41-4b17-8b58-b7d26ea618d7. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Creating volume glance metadata for volume dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 backed by image d615f633-2881-4d59-aa2e-ff4db61859d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cef36a-0054-416e-bf31-e26318bb6f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7e4ae2-ba91-4bcf-bf9c-b34d0d89f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:11 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Volume volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 (dcc1f9f0-af41-4b17-8b58-b7d26ea618d7): created successfully Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7e4ae2-ba91-4bcf-bf9c-b34d0d89f216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Flow 'volume_create_manager' (b7b6714f-127c-4d80-83c3-e0dcb888e79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-be39cba6-8294-4dac-8fa1-902271da2cb4 tempest-VolumesImageMetadata-586782065 None] Created volume successfully. Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Flow 'volume_create_manager' (beaf3b30-d6d9-469e-9b0a-e2f203ce9a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7ef8c2-ae58-4251-a849-4f89c108c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7ef8c2-ae58-4251-a849-4f89c108c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1952785982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a8764f-80d7-4a89-b8f9-0084006f4072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4e199991e643c084303f1d843ec5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:12Z,use_quota=True,user_id='4d1edff02955493894d5faf045d3174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b866bd-1c12-4660-94e9-314944cd159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b866bd-1c12-4660-94e9-314944cd159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2580223-6aee-47cd-9582-a7920343f024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2580223-6aee-47cd-9582-a7920343f024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a8764f-80d7-4a89-b8f9-0084006f4072', 'volume_name': 'volume-34a8764f-80d7-4a89-b8f9-0084006f4072', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ca7476-5c4f-48bf-bbb5-b695a4bdc7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ca7476-5c4f-48bf-bbb5-b695a4bdc7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328b4372-8b51-4473-9edb-5a9fd61d418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:12 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Volume 34a8764f-80d7-4a89-b8f9-0084006f4072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a8764f-80d7-4a89-b8f9-0084006f4072', 'volume_size': 1} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1952785982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a8764f-80d7-4a89-b8f9-0084006f4072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4e199991e643c084303f1d843ec5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:12Z,use_quota=True,user_id='4d1edff02955493894d5faf045d3174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Creating volume 34a8764f-80d7-4a89-b8f9-0084006f4072 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:12 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:12 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 1073741824 Jul 17 07:11:12 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:12 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 1073741824" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:12 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 Jul 17 07:11:12 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:12 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072" returned: 0 in 0.249s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328b4372-8b51-4473-9edb-5a9fd61d418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a8764f-80d7-4a89-b8f9-0084006f4072', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc6f8cb-7f76-4642-b8b0-371e7abf9099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:12 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Volume volume-34a8764f-80d7-4a89-b8f9-0084006f4072 (34a8764f-80d7-4a89-b8f9-0084006f4072): created successfully Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc6f8cb-7f76-4642-b8b0-371e7abf9099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Flow 'volume_create_manager' (beaf3b30-d6d9-469e-9b0a-e2f203ce9a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0c774e44-2b94-4a2b-a9f2-bf00febff3d4 tempest-VolumesTransfersTest-1588806034 None] Created volume successfully. Jul 17 07:11:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Acquiring lock "cinder-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Lock "cinder-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Acquiring lock "cinder-quobyte-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Lock "cinder-quobyte-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:13 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[255978a6-71f3-42d1-8da1-c20db96fe331]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:13 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 Jul 17 07:11:13 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4f9321cf-b974-48cc-97cf-c91165f46d2c tempest-VolumesTransfersTest-1742550786 None] Transfer volume completed successfully. Jul 17 07:11:14 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:14 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7 Jul 17 07:11:14 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:14 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" returned: 0 in 0.288s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Lock "cinder-quobyte-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7" released by "delete_volume" :: held 0.765s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Created reservations ['822e8a57-45ac-49a4-bd0f-6a318c6e2ae2', 'bafb0443-6dcb-4c05-b3c0-d35d4cb69de7', '5e498e55-2e82-4d18-a28e-aad19817a9cf', 'c6e0b488-7aa1-4673-a27f-f7c8a127258b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Acquiring lock "cinder-34a8764f-80d7-4a89-b8f9-0084006f4072-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-34a8764f-80d7-4a89-b8f9-0084006f4072-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Acquiring lock "cinder-quobyte-34a8764f-80d7-4a89-b8f9-0084006f4072" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:14 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:14 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-quobyte-34a8764f-80d7-4a89-b8f9-0084006f4072" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d63148-99f8-4f6a-bdc1-2809711c6870]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:14 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 Jul 17 07:11:14 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:14 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Deleted volume successfully. Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5b94a278-5a4a-4f7f-88c2-e64c8708bf7d tempest-VolumesImageMetadata-586782065 None] Lock "cinder-dcc1f9f0-af41-4b17-8b58-b7d26ea618d7-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:14 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:15 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072 Jul 17 07:11:15 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:15 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-34a8764f-80d7-4a89-b8f9-0084006f4072" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-quobyte-34a8764f-80d7-4a89-b8f9-0084006f4072" released by "delete_volume" :: held 0.763s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Created reservations ['16e6de53-bab7-4517-a8eb-ff430343d9f3', '9bda3987-db51-4ba5-af2d-501ae83f1dcc', '4d791b36-2274-44b1-8bf8-ddd818bea41c', 'c5e095e5-ffd7-4cb7-a7a5-2d80e289b36f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:15 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:15 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:15 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.303s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:15 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Deleted volume successfully. Jul 17 07:11:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbef2971-27b2-4eef-9f75-85f77c493466 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-34a8764f-80d7-4a89-b8f9-0084006f4072-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Flow 'volume_create_manager' (b61a2ad2-ccd9-4312-bd09-f66428bcc435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c190fb-c450-4cf4-b973-86eb246628d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c190fb-c450-4cf4-b973-86eb246628d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-299152385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856b9a36-7186-4acd-80ce-b338a62b0f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4e199991e643c084303f1d843ec5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:16Z,use_quota=True,user_id='4d1edff02955493894d5faf045d3174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dd6f21-0f66-4bbc-bbce-490fb5481d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dd6f21-0f66-4bbc-bbce-490fb5481d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a876412-03f0-48ab-9af8-be7adb6524e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a876412-03f0-48ab-9af8-be7adb6524e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856b9a36-7186-4acd-80ce-b338a62b0f44', 'volume_name': 'volume-856b9a36-7186-4acd-80ce-b338a62b0f44', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5f4fa-3eb7-4fe4-9685-bd3fa7a6f7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5f4fa-3eb7-4fe4-9685-bd3fa7a6f7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec1f492-4a6d-4d67-bf69-7ccc132190f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Volume 856b9a36-7186-4acd-80ce-b338a62b0f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856b9a36-7186-4acd-80ce-b338a62b0f44', 'volume_size': 1} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-299152385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856b9a36-7186-4acd-80ce-b338a62b0f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4e199991e643c084303f1d843ec5ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:16Z,use_quota=True,user_id='4d1edff02955493894d5faf045d3174a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Creating volume 856b9a36-7186-4acd-80ce-b338a62b0f44 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:16 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:16 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 1073741824 Jul 17 07:11:16 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:16 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 1073741824" returned: 0 in 0.452s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:16 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 Jul 17 07:11:16 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:17 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44" returned: 0 in 0.268s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec1f492-4a6d-4d67-bf69-7ccc132190f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856b9a36-7186-4acd-80ce-b338a62b0f44', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0975c212-902a-400f-8402-728f6ff2acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Volume volume-856b9a36-7186-4acd-80ce-b338a62b0f44 (856b9a36-7186-4acd-80ce-b338a62b0f44): created successfully Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0975c212-902a-400f-8402-728f6ff2acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Flow 'volume_create_manager' (b61a2ad2-ccd9-4312-bd09-f66428bcc435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-01f60ede-9a5f-4abd-992e-c07079d06272 tempest-VolumesTransfersTest-1588806034 None] Created volume successfully. Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Flow 'volume_create_manager' (d1d8efa1-f673-4ede-81da-b75c83716098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008f9b65-af9f-4f78-93d5-c53e7ca02027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008f9b65-af9f-4f78-93d5-c53e7ca02027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-952383021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4717090d-1835-4001-984a-877ac58ad975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29517b06767d426b9fc6b386f48cefbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:18Z,use_quota=True,user_id='868965958b32448a94103cb241f75c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5e0ef8-dde9-4e65-b5b1-c3d56b343e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5e0ef8-dde9-4e65-b5b1-c3d56b343e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223a29b0-88ea-4068-8f69-ea4e7ec40c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223a29b0-88ea-4068-8f69-ea4e7ec40c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4717090d-1835-4001-984a-877ac58ad975', 'volume_name': 'volume-4717090d-1835-4001-984a-877ac58ad975', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55355b3-96b9-4ed6-9c64-86ccb78010c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55355b3-96b9-4ed6-9c64-86ccb78010c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98972456-2d48-42b7-b905-523a65798a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Volume 4717090d-1835-4001-984a-877ac58ad975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4717090d-1835-4001-984a-877ac58ad975', 'volume_size': 1} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-952383021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4717090d-1835-4001-984a-877ac58ad975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29517b06767d426b9fc6b386f48cefbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:18Z,use_quota=True,user_id='868965958b32448a94103cb241f75c99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Creating volume 4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:17 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:17 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 1073741824 Jul 17 07:11:17 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:18 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 1073741824" returned: 0 in 0.604s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-45508cd5-3f43-476b-8641-d1cfce07c3e9 req-41ce1a74-995e-442a-af59-87ab8b1e193f tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:18 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 Jul 17 07:11:18 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Acquiring lock "cinder-856b9a36-7186-4acd-80ce-b338a62b0f44-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-856b9a36-7186-4acd-80ce-b338a62b0f44-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Acquiring lock "cinder-quobyte-856b9a36-7186-4acd-80ce-b338a62b0f44" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-quobyte-856b9a36-7186-4acd-80ce-b338a62b0f44" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90b0406-3cad-4da1-b5b4-c018d56911b0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:18 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-45508cd5-3f43-476b-8641-d1cfce07c3e9 req-41ce1a74-995e-442a-af59-87ab8b1e193f tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.316s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-45508cd5-3f43-476b-8641-d1cfce07c3e9 req-41ce1a74-995e-442a-af59-87ab8b1e193f tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98972456-2d48-42b7-b905-523a65798a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4717090d-1835-4001-984a-877ac58ad975', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce25f2e-de12-47cf-a703-22b180f26968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Volume volume-4717090d-1835-4001-984a-877ac58ad975 (4717090d-1835-4001-984a-877ac58ad975): created successfully Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce25f2e-de12-47cf-a703-22b180f26968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Flow 'volume_create_manager' (d1d8efa1-f673-4ede-81da-b75c83716098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c63bea25-dbb1-4e0e-9c72-6e14f6c6b9fd tempest-SnapshotMetadataTestJSON-882164173 None] Created volume successfully. Jul 17 07:11:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-45508cd5-3f43-476b-8641-d1cfce07c3e9 req-41ce1a74-995e-442a-af59-87ab8b1e193f tempest-TestInstancesWithCinderVolumes-382292082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5684f79b-c773-4346-a6f7-ead9a633923e', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:11:18 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 Jul 17 07:11:18 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-45508cd5-3f43-476b-8641-d1cfce07c3e9 req-41ce1a74-995e-442a-af59-87ab8b1e193f tempest-TestInstancesWithCinderVolumes-382292082 None] attachment_update completed successfully. Jul 17 07:11:19 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:19 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44 Jul 17 07:11:19 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:19 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-856b9a36-7186-4acd-80ce-b338a62b0f44" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-quobyte-856b9a36-7186-4acd-80ce-b338a62b0f44" released by "delete_volume" :: held 0.780s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Created reservations ['80f8b986-f683-48f0-bfe6-5529b19cadc5', '441603a9-4036-4380-b992-28c05439c5bf', '0d45916a-bf96-44f9-94e4-51a18c4bf555', 'c935c9cc-39ca-4083-86ab-5a6b48ff97af'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:19 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:19 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:19 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.297s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Deleted volume successfully. Jul 17 07:11:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a71720dc-a34f-4bfd-b0f7-130a923e7ca1 tempest-VolumesTransfersTest-1973230661 None] Lock "cinder-856b9a36-7186-4acd-80ce-b338a62b0f44-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Creating offline snapshot 0dded6d3-11f2-43e1-beff-685a0ad77917 of volume 4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b74a1-d719-43f2-a701-e6f9d6406a8f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:20 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 Jul 17 07:11:20 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:20 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:20 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 1G Jul 17 07:11:20 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:21 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 1G" returned: 0 in 0.483s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4717090d-1835-4001-984a-877ac58ad975 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:21 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4717090d-1835-4001-984a-877ac58ad975 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 Jul 17 07:11:21 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:21 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4717090d-1835-4001-984a-877ac58ad975 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917" returned: 0 in 0.374s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:21 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 is being set with open permissions: ugo+rw Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:21 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 Jul 17 07:11:21 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:21 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917" returned: 0 in 0.310s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:21 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info Jul 17 07:11:21 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c1f4731b-29ec-407e-ae05-f1362f00c2b4 req-698e0e28-7c79-4455-93c3-c53964b2ee5a tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:22 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info" returned: 0 in 0.301s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:22 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info is being set with open permissions: ugo+rw Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:22 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info Jul 17 07:11:22 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:22 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.info" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c1f4731b-29ec-407e-ae05-f1362f00c2b4 req-698e0e28-7c79-4455-93c3-c53964b2ee5a tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.507s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-c1f4731b-29ec-407e-ae05-f1362f00c2b4 req-698e0e28-7c79-4455-93c3-c53964b2ee5a tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4a27e32b-440a-4c68-9880-aadb0320314b tempest-SnapshotMetadataTestJSON-882164173 None] Create snapshot completed successfully Jul 17 07:11:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-c1f4731b-29ec-407e-ae05-f1362f00c2b4 req-698e0e28-7c79-4455-93c3-c53964b2ee5a tempest-TestInstancesWithCinderVolumes-382292082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-77710c45-73ef-4052-8ba2-c7130ce32d73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f730a2e-8de7-43f0-9b3f-e5836b5d8a81', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:11:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-c1f4731b-29ec-407e-ae05-f1362f00c2b4 req-698e0e28-7c79-4455-93c3-c53964b2ee5a tempest-TestInstancesWithCinderVolumes-382292082 None] attachment_update completed successfully. Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-608b08a0-2e13-458b-a658-1371d232739c req-552e067a-7b91-4610-a485-627eb8d49ea8 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-608b08a0-2e13-458b-a658-1371d232739c req-552e067a-7b91-4610-a485-627eb8d49ea8 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-608b08a0-2e13-458b-a658-1371d232739c req-552e067a-7b91-4610-a485-627eb8d49ea8 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-608b08a0-2e13-458b-a658-1371d232739c req-552e067a-7b91-4610-a485-627eb8d49ea8 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75658a4e-6d53-4f8d-ad50-d9e22c750c90', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "cinder-0dded6d3-11f2-43e1-beff-685a0ad77917-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-0dded6d3-11f2-43e1-beff-685a0ad77917-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "cinder-quobyte-4717090d-1835-4001-984a-877ac58ad975" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-quobyte-4717090d-1835-4001-984a-877ac58ad975" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "cinder-quobyte-0dded6d3-11f2-43e1-beff-685a0ad77917" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-quobyte-0dded6d3-11f2-43e1-beff-685a0ad77917" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Deleting offline snapshot 0dded6d3-11f2-43e1-beff-685a0ad77917 of volume 4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] snapshot_file for this snap is: volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c90d3a9-f121-411f-9650-d37b082aaabc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:24 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-608b08a0-2e13-458b-a658-1371d232739c req-552e067a-7b91-4610-a485-627eb8d49ea8 tempest-TestServerVolumeAttachmentScenario-1537438780 None] attachment_update completed successfully. Jul 17 07:11:24 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 Jul 17 07:11:24 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:24 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917" returned: 0 in 0.523s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4717090d-1835-4001-984a-877ac58ad975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed2dde3-ac1b-4d87-bd57-69988a913bb6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:25 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 Jul 17 07:11:25 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:25 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975" returned: 0 in 0.427s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:25 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 Jul 17 07:11:25 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:25 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917" returned: 0 in 0.365s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:25 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917 Jul 17 07:11:25 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:26 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975.0dded6d3-11f2-43e1-beff-685a0ad77917" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-quobyte-0dded6d3-11f2-43e1-beff-685a0ad77917" released by "_delete_snapshot" :: held 1.756s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-quobyte-4717090d-1835-4001-984a-877ac58ad975" released by "delete_snapshot" :: held 1.800s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Created reservations ['c5886a96-ff6f-4fbc-b9a3-f44777da7775', 'ebdc33b9-b234-42bc-8c49-4520154071c4', 'ea4b4c0e-f63f-46a4-9c17-5ec1d8baa92e', '418d8f7f-d398-4fa6-972c-401f3c5ed7f8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Delete snapshot completed successfully. Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-20faec49-815c-4c2d-b673-a12361801773 tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-0dded6d3-11f2-43e1-beff-685a0ad77917-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "cinder-4717090d-1835-4001-984a-877ac58ad975-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-4717090d-1835-4001-984a-877ac58ad975-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "cinder-quobyte-4717090d-1835-4001-984a-877ac58ad975" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-quobyte-4717090d-1835-4001-984a-877ac58ad975" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c23fe-6af1-4159-8c61-6d8c5146cabc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:26 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 Jul 17 07:11:26 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:27 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975" returned: 0 in 0.468s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:27 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975 Jul 17 07:11:27 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:27 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4717090d-1835-4001-984a-877ac58ad975" returned: 0 in 0.329s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-quobyte-4717090d-1835-4001-984a-877ac58ad975" released by "delete_volume" :: held 0.884s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Created reservations ['8bcea284-115b-46bc-9221-4b553cd7c86a', 'd3f2d55e-4be0-4f12-b31b-6ad39260ae28', '169646fb-89e2-4da8-a7bf-97ce2399d850', '2850cffc-f8a4-4b5d-bc25-1c6d9a35fda0'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:27 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:27 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:28 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.341s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Deleted volume successfully. Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a7d0dea-5b45-4c8a-9524-e8a536a566fb tempest-SnapshotMetadataTestJSON-882164173 None] Lock "cinder-4717090d-1835-4001-984a-877ac58ad975-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Flow 'volume_create_manager' (34c92ed7-eac0-473e-ae41-b4528fc7ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293fbdbd-eee7-4fdb-ab76-83d83b6c74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293fbdbd-eee7-4fdb-ab76-83d83b6c74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1223186485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b947e2-ae7e-4feb-9add-77800c6bfdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b9667d72084964ac48336b95a2d407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:29Z,use_quota=True,user_id='f46f416e8bd04201bc6968ab7229c8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b677147-f879-4682-81cd-8a72e0cc7dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b677147-f879-4682-81cd-8a72e0cc7dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bf262b-7f84-434c-a3d3-3c1b3cb4e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bf262b-7f84-434c-a3d3-3c1b3cb4e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b947e2-ae7e-4feb-9add-77800c6bfdc3', 'volume_name': 'volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc925690-7e0e-4ab8-a0b9-5f73ff9445aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc925690-7e0e-4ab8-a0b9-5f73ff9445aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9708ecee-e972-4732-bb47-888ad0fb0160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Volume b3b947e2-ae7e-4feb-9add-77800c6bfdc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3', 'volume_size': 1} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1223186485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b947e2-ae7e-4feb-9add-77800c6bfdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b9667d72084964ac48336b95a2d407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:29Z,use_quota=True,user_id='f46f416e8bd04201bc6968ab7229c8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Creating volume b3b947e2-ae7e-4feb-9add-77800c6bfdc3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:28 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:28 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 1073741824 Jul 17 07:11:28 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-262056f6-bb87-4afc-8a94-6498a6d67e3e req-c3b93fdc-effe-4787-9d90-e097acf9a6ce tempest-TestInstancesWithCinderVolumes-382292082 None] Terminate volume connection completed successfully. Jul 17 07:11:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-262056f6-bb87-4afc-8a94-6498a6d67e3e req-c3b93fdc-effe-4787-9d90-e097acf9a6ce tempest-TestInstancesWithCinderVolumes-382292082 None] Deleting attachment 5684f79b-c773-4346-a6f7-ead9a633923e. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:11:29 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 1073741824" returned: 0 in 0.629s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:29 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 Jul 17 07:11:29 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "cinder-1071bebf-4a1e-47e4-8f0c-e3013a784b2e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-1071bebf-4a1e-47e4-8f0c-e3013a784b2e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "cinder-quobyte-1071bebf-4a1e-47e4-8f0c-e3013a784b2e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-quobyte-1071bebf-4a1e-47e4-8f0c-e3013a784b2e" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bdea98-8a44-4763-ae30-a41e7faafa16]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:29 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3" returned: 0 in 0.413s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9708ecee-e972-4732-bb47-888ad0fb0160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4032ab3c-3a08-455b-ac20-42bc6529a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:29 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Volume volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 (b3b947e2-ae7e-4feb-9add-77800c6bfdc3): created successfully Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4032ab3c-3a08-455b-ac20-42bc6529a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Flow 'volume_create_manager' (34c92ed7-eac0-473e-ae41-b4528fc7ce63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-19780536-dbc3-4c60-bf22-1387ab8c9e89 tempest-VolumesTransfersV355Test-882251882 None] Created volume successfully. Jul 17 07:11:29 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:29 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:29 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e Jul 17 07:11:29 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:30 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.350s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:11:30 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e" returned: 0 in 0.528s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:30 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e Jul 17 07:11:30 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:30 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1071bebf-4a1e-47e4-8f0c-e3013a784b2e" returned: 0 in 0.357s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-quobyte-1071bebf-4a1e-47e4-8f0c-e3013a784b2e" released by "delete_volume" :: held 0.945s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:30 devstack cinder-volume[87331]: WARNING cinder.quota [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553174232-1860337061 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553174232-1860337061, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:11:30 devstack cinder-volume[87331]: WARNING cinder.quota [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553174232-1860337061 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-553174232-1860337061, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Created reservations ['c3516126-795d-445d-8e3d-021ab1abdf3a', '35a57c61-e269-4e43-a03e-9ebcbcc0043d', 'caf38055-f94c-446e-afc2-e5a6c299e5f2', '0298dc27-ba92-429f-9eb8-0b30b64587ef'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-9fe07209-9f6a-488a-a908-7230b4389df3 req-ef6dc4ec-6687-401b-b14b-c7cc2ee9124b tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-9fe07209-9f6a-488a-a908-7230b4389df3 req-ef6dc4ec-6687-401b-b14b-c7cc2ee9124b tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-9fe07209-9f6a-488a-a908-7230b4389df3 req-ef6dc4ec-6687-401b-b14b-c7cc2ee9124b tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-9fe07209-9f6a-488a-a908-7230b4389df3 req-ef6dc4ec-6687-401b-b14b-c7cc2ee9124b tempest-TestServerVolumeAttachmentScenario-1537438780 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-d8da5753-4585-4733-9ec1-10431d415f13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45cfa6c0-5970-4c9e-a0ec-183a58048cb7', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:30 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:30 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:30 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-9fe07209-9f6a-488a-a908-7230b4389df3 req-ef6dc4ec-6687-401b-b14b-c7cc2ee9124b tempest-TestServerVolumeAttachmentScenario-1537438780 None] attachment_update completed successfully. Jul 17 07:11:31 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:31 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Deleted volume successfully. Jul 17 07:11:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-78e4b2a5-ba75-4512-990c-0b027d9db406 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-1071bebf-4a1e-47e4-8f0c-e3013a784b2e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cc03a71b-bc88-463f-beb2-3865db28045a tempest-VolumesTransfersV355Test-142990101 None] Transfer volume completed successfully. Jul 17 07:11:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Acquiring lock "cinder-b3b947e2-ae7e-4feb-9add-77800c6bfdc3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-b3b947e2-ae7e-4feb-9add-77800c6bfdc3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Acquiring lock "cinder-quobyte-b3b947e2-ae7e-4feb-9add-77800c6bfdc3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-quobyte-b3b947e2-ae7e-4feb-9add-77800c6bfdc3" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d66f369-c7e4-47c1-afcd-a7a578880b55]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:32 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 Jul 17 07:11:32 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:33 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3" returned: 0 in 0.504s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:33 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3 Jul 17 07:11:33 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:33 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b3b947e2-ae7e-4feb-9add-77800c6bfdc3" returned: 0 in 0.301s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-quobyte-b3b947e2-ae7e-4feb-9add-77800c6bfdc3" released by "delete_volume" :: held 0.866s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:33 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-8d33b130-ff93-4fbe-9573-4f78a09b33ee req-1d372871-9baf-4c5a-821f-12e98c3febd2 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Terminate volume connection completed successfully. Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-8d33b130-ff93-4fbe-9573-4f78a09b33ee req-1d372871-9baf-4c5a-821f-12e98c3febd2 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Deleting attachment 45cfa6c0-5970-4c9e-a0ec-183a58048cb7. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Created reservations ['4c0c37b0-228b-46e3-b055-2da697ce39c1', 'cddaca4c-340f-4739-93b8-bf207113b17d', '0ba180cb-9e97-4299-ba8b-2d78f0256af4', '1e3d8cf8-bcc7-4c40-bcd7-de5e026cc587'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:33 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:33 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:34 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Deleted volume successfully. Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32841f56-7032-46dd-96d1-8a66cca1334e tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-b3b947e2-ae7e-4feb-9add-77800c6bfdc3-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Flow 'volume_create_manager' (a0091407-5519-4eac-ae9e-a9dca335b4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a41dba-9365-4d1f-96b5-84238bed4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-54559373-208b-4d55-9056-dd1b8649f573 req-1c80e27b-71f8-4c7a-b33a-4cc1fbab2738 tempest-TestInstancesWithCinderVolumes-382292082 None] Terminate volume connection completed successfully. Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-54559373-208b-4d55-9056-dd1b8649f573 req-1c80e27b-71f8-4c7a-b33a-4cc1fbab2738 tempest-TestInstancesWithCinderVolumes-382292082 None] Deleting attachment 1f730a2e-8de7-43f0-9b3f-e5836b5d8a81. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a41dba-9365-4d1f-96b5-84238bed4811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-18783737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c683205f-267b-43ae-86a8-3a0e8bcf6118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505a959d0d194695ad8d23805f3acff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:34Z,use_quota=True,user_id='b1e07723d9314e8b952454ffa8401afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633b2c14-72cf-4ec8-a445-42995dd8de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633b2c14-72cf-4ec8-a445-42995dd8de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d26a9be-b292-4dea-bbb8-55692b3fad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d26a9be-b292-4dea-bbb8-55692b3fad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c683205f-267b-43ae-86a8-3a0e8bcf6118', 'volume_name': 'volume-c683205f-267b-43ae-86a8-3a0e8bcf6118', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae68fe-f170-4e57-8d46-c7b6936888f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dae68fe-f170-4e57-8d46-c7b6936888f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d044bf0-a81a-4b8d-9ac9-117f51f7065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Volume c683205f-267b-43ae-86a8-3a0e8bcf6118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c683205f-267b-43ae-86a8-3a0e8bcf6118', 'volume_size': 1} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-18783737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c683205f-267b-43ae-86a8-3a0e8bcf6118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505a959d0d194695ad8d23805f3acff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:34Z,use_quota=True,user_id='b1e07723d9314e8b952454ffa8401afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Creating volume c683205f-267b-43ae-86a8-3a0e8bcf6118 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:34 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:34 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 1073741824 Jul 17 07:11:34 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Flow 'volume_create_manager' (8bb6efcb-0821-4a8d-806c-899ddad8cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459827fd-72e0-44b2-864d-35f101b603b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459827fd-72e0-44b2-864d-35f101b603b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1418498312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4581e373-422f-4e5e-afa4-6087a6cb82c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b9667d72084964ac48336b95a2d407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:35Z,use_quota=True,user_id='f46f416e8bd04201bc6968ab7229c8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5b5e10-bbb4-43a8-ae16-72db177d0939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5b5e10-bbb4-43a8-ae16-72db177d0939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc399a7-0131-4432-af80-b9484468cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc399a7-0131-4432-af80-b9484468cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4581e373-422f-4e5e-afa4-6087a6cb82c6', 'volume_name': 'volume-4581e373-422f-4e5e-afa4-6087a6cb82c6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930cf369-f6ec-447f-8085-f9c65c837c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930cf369-f6ec-447f-8085-f9c65c837c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d827b6f-52c8-4b59-8ad7-652a4c669a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Volume 4581e373-422f-4e5e-afa4-6087a6cb82c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4581e373-422f-4e5e-afa4-6087a6cb82c6', 'volume_size': 1} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "cinder-77710c45-73ef-4052-8ba2-c7130ce32d73-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-77710c45-73ef-4052-8ba2-c7130ce32d73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:34 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 1073741824" returned: 0 in 0.605s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "cinder-quobyte-77710c45-73ef-4052-8ba2-c7130ce32d73" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-quobyte-77710c45-73ef-4052-8ba2-c7130ce32d73" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac865a7e-a0af-44af-a3f4-1de27b009cf2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:35 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 Jul 17 07:11:35 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:35 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 Jul 17 07:11:35 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:35 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1418498312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4581e373-422f-4e5e-afa4-6087a6cb82c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b9667d72084964ac48336b95a2d407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:35Z,use_quota=True,user_id='f46f416e8bd04201bc6968ab7229c8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Creating volume 4581e373-422f-4e5e-afa4-6087a6cb82c6 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:35 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d044bf0-a81a-4b8d-9ac9-117f51f7065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c683205f-267b-43ae-86a8-3a0e8bcf6118', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:35 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 1073741824 Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f3179-1b31-4a9d-b15f-635b8fdc7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:35 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-64c73491-91e6-4e8e-85eb-d46f6b66ae90 req-6bbb768a-665f-465b-a1cb-61745fa079f3 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Terminate volume connection completed successfully. Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-64c73491-91e6-4e8e-85eb-d46f6b66ae90 req-6bbb768a-665f-465b-a1cb-61745fa079f3 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Deleting attachment 75658a4e-6d53-4f8d-ad50-d9e22c750c90. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:11:35 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Volume volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 (c683205f-267b-43ae-86a8-3a0e8bcf6118): created successfully Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f3179-1b31-4a9d-b15f-635b8fdc7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Flow 'volume_create_manager' (a0091407-5519-4eac-ae9e-a9dca335b4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8a1e4993-b928-45cb-bc4d-b213a6e7e2fb tempest-VolumesTransfersV357Test-1871565510 None] Created volume successfully. Jul 17 07:11:35 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73" returned: 0 in 0.577s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:35 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73 Jul 17 07:11:35 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:35 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-77710c45-73ef-4052-8ba2-c7130ce32d73" returned: 0 in 0.268s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-quobyte-77710c45-73ef-4052-8ba2-c7130ce32d73" released by "delete_volume" :: held 0.900s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:35 devstack cinder-volume[87331]: WARNING cinder.quota [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-348962733-2032766903 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-348962733-2032766903, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:11:35 devstack cinder-volume[87331]: WARNING cinder.quota [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-348962733-2032766903 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-348962733-2032766903, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:11:35 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Created reservations ['f26cc4ef-f535-4c17-85df-fc7076cd83bb', '2aacd1ab-7c0a-4c2f-9684-cc9b404862d6', '34975e56-ded7-476e-b02d-410ea997d015', '7bb59c5f-00db-4e25-a27b-688cff6191c5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:36 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 1073741824" returned: 0 in 0.583s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:36 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 Jul 17 07:11:36 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:36 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:36 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:36 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.341s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Deleted volume successfully. Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9c502652-12fe-4b7f-b57c-141a431addd4 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-77710c45-73ef-4052-8ba2-c7130ce32d73-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:36 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6" returned: 0 in 0.449s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d827b6f-52c8-4b59-8ad7-652a4c669a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4581e373-422f-4e5e-afa4-6087a6cb82c6', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6041990-9bbd-47b6-99c6-3c85b86712e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:36 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Volume volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 (4581e373-422f-4e5e-afa4-6087a6cb82c6): created successfully Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6041990-9bbd-47b6-99c6-3c85b86712e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Flow 'volume_create_manager' (8bb6efcb-0821-4a8d-806c-899ddad8cfde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9daed7fe-706f-4a76-b0c6-22c06e82cfb4 tempest-VolumesTransfersV355Test-882251882 None] Created volume successfully. Jul 17 07:11:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Acquiring lock "cinder-4581e373-422f-4e5e-afa4-6087a6cb82c6-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-4581e373-422f-4e5e-afa4-6087a6cb82c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Acquiring lock "cinder-quobyte-4581e373-422f-4e5e-afa4-6087a6cb82c6" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-quobyte-4581e373-422f-4e5e-afa4-6087a6cb82c6" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:37 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb3d19-d6a5-4a9b-b421-9d3c5cb92879]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:37 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-05139db3-030f-428b-84c7-59a28b52b452 tempest-VolumesTransfersV357Test-1075820469 None] Transfer volume completed successfully. Jul 17 07:11:37 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 Jul 17 07:11:37 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:38 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6" returned: 0 in 0.523s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:38 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6 Jul 17 07:11:38 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Acquiring lock "cinder-c683205f-267b-43ae-86a8-3a0e8bcf6118-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-c683205f-267b-43ae-86a8-3a0e8bcf6118-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Acquiring lock "cinder-quobyte-c683205f-267b-43ae-86a8-3a0e8bcf6118" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-quobyte-c683205f-267b-43ae-86a8-3a0e8bcf6118" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f6dce-0119-4bc9-802d-5450328755de]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:38 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4581e373-422f-4e5e-afa4-6087a6cb82c6" returned: 0 in 0.335s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-quobyte-4581e373-422f-4e5e-afa4-6087a6cb82c6" released by "delete_volume" :: held 0.927s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Created reservations ['d09f0f3d-09af-4d0b-9b91-fa319e24ce26', '5afdda4e-5719-4b72-a3f5-b83ace507ef5', 'e46db5cc-83fc-48db-9e60-f685db7efb88', '3aa41794-7d1b-401d-a119-9bbf47789c57'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:38 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 Jul 17 07:11:38 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:38 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:38 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:39 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118" returned: 0 in 0.560s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:39 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118 Jul 17 07:11:39 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:39 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.404s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Deleted volume successfully. Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ae629cb9-2108-457c-a788-0019288ce6e4 tempest-VolumesTransfersV355Test-1165778934 None] Lock "cinder-4581e373-422f-4e5e-afa4-6087a6cb82c6-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:39 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c683205f-267b-43ae-86a8-3a0e8bcf6118" returned: 0 in 0.437s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-quobyte-c683205f-267b-43ae-86a8-3a0e8bcf6118" released by "delete_volume" :: held 1.069s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Created reservations ['b9881c00-ee6f-4621-bbe9-ee2ac364636d', 'd8f68a98-0947-48cd-9bc9-b31a6bc3d7a7', 'aa48f295-57f8-46b9-a8e4-1263b2338d80', '74c6f293-1062-4fa3-9d06-2adaa449f911'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:39 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:39 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:40 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.520s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:40 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Deleted volume successfully. Jul 17 07:11:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-850cc15a-0ca1-468d-b442-8c9a7efe6ef5 tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-c683205f-267b-43ae-86a8-3a0e8bcf6118-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-376ebaf8-9d1a-43ae-89f7-811ba41f50d8 req-30b7ac2d-c94b-454b-ba06-d31dcd783788 tempest-TestInstancesWithCinderVolumes-382292082 None] Terminate volume connection completed successfully. Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-376ebaf8-9d1a-43ae-89f7-811ba41f50d8 req-30b7ac2d-c94b-454b-ba06-d31dcd783788 tempest-TestInstancesWithCinderVolumes-382292082 None] Deleting attachment 60fc11b7-a48a-49eb-a447-d16615dfbcb3. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Flow 'volume_create_manager' (ef3b1a95-2a7c-4739-a31e-ebe6457484ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badea9aa-b342-4e4e-ade5-edcd8a92e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badea9aa-b342-4e4e-ade5-edcd8a92e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1611474574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1869632-7f8b-479e-bd84-64c73b77304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505a959d0d194695ad8d23805f3acff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:42Z,use_quota=True,user_id='b1e07723d9314e8b952454ffa8401afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2154af16-de9f-4023-ad64-649237cada1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2154af16-de9f-4023-ad64-649237cada1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db78aec-65e8-44de-910e-92213452adaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db78aec-65e8-44de-910e-92213452adaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1869632-7f8b-479e-bd84-64c73b77304c', 'volume_name': 'volume-e1869632-7f8b-479e-bd84-64c73b77304c', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9e6eee-682c-41ab-b6d7-21ca7a7ec6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9e6eee-682c-41ab-b6d7-21ca7a7ec6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a36553a-566f-492b-a6c8-98250fce8eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Volume e1869632-7f8b-479e-bd84-64c73b77304c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1869632-7f8b-479e-bd84-64c73b77304c', 'volume_size': 1} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1611474574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1869632-7f8b-479e-bd84-64c73b77304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505a959d0d194695ad8d23805f3acff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:42Z,use_quota=True,user_id='b1e07723d9314e8b952454ffa8401afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Creating volume e1869632-7f8b-479e-bd84-64c73b77304c {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:41 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:41 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c 1073741824 Jul 17 07:11:41 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:42 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "cinder-2cdeebd1-3558-48d2-964e-ab6c8a581e68-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c 1073741824" returned: 0 in 0.574s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-2cdeebd1-3558-48d2-964e-ab6c8a581e68-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "cinder-quobyte-2cdeebd1-3558-48d2-964e-ab6c8a581e68" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:42 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c Jul 17 07:11:42 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-quobyte-2cdeebd1-3558-48d2-964e-ab6c8a581e68" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9261ef-4fd9-4330-a213-1fe9837b244f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:42 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 Jul 17 07:11:42 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:42 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a36553a-566f-492b-a6c8-98250fce8eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1869632-7f8b-479e-bd84-64c73b77304c', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7273f5e4-9162-4e3f-8e7d-49c18f3a7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Volume volume-e1869632-7f8b-479e-bd84-64c73b77304c (e1869632-7f8b-479e-bd84-64c73b77304c): created successfully Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7273f5e4-9162-4e3f-8e7d-49c18f3a7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Flow 'volume_create_manager' (ef3b1a95-2a7c-4739-a31e-ebe6457484ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a2c7a8ea-1f61-469b-965b-049a91e5a140 tempest-VolumesTransfersV357Test-1871565510 None] Created volume successfully. Jul 17 07:11:42 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:42 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68 Jul 17 07:11:42 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:43 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2cdeebd1-3558-48d2-964e-ab6c8a581e68" returned: 0 in 0.355s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-quobyte-2cdeebd1-3558-48d2-964e-ab6c8a581e68" released by "delete_volume" :: held 0.849s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:43 devstack cinder-volume[87331]: WARNING cinder.quota [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1330096304-1596545757 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1330096304-1596545757, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:11:43 devstack cinder-volume[87331]: WARNING cinder.quota [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1330096304-1596545757 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1330096304-1596545757, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Created reservations ['75d4582f-3f87-4ddf-8191-8dd207701e15', '310d567e-12c2-402f-8800-b43b6e367c6f', 'fb3323af-ed97-4aaa-a655-5527314d017d', '4ee130b0-cbfa-4111-8bff-f108278cc148'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:43 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:43 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:43 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.410s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Deleted volume successfully. Jul 17 07:11:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-15a6e381-1bec-47db-a52a-853408143392 tempest-TestInstancesWithCinderVolumes-382292082 None] Lock "cinder-2cdeebd1-3558-48d2-964e-ab6c8a581e68-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Acquiring lock "cinder-e1869632-7f8b-479e-bd84-64c73b77304c-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "cinder-d8da5753-4585-4733-9ec1-10431d415f13-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-e1869632-7f8b-479e-bd84-64c73b77304c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-d8da5753-4585-4733-9ec1-10431d415f13-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Acquiring lock "cinder-quobyte-e1869632-7f8b-479e-bd84-64c73b77304c" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "cinder-quobyte-d8da5753-4585-4733-9ec1-10431d415f13" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-quobyte-e1869632-7f8b-479e-bd84-64c73b77304c" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-quobyte-d8da5753-4585-4733-9ec1-10431d415f13" acquired by "delete_volume" :: waited 0.037s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[97600083-a138-4800-9d19-4fd036473506]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea48bd-5299-4fbe-b0e8-8b1d770de4da]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:44 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c Jul 17 07:11:44 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 Jul 17 07:11:44 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:44 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:44 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13" returned: 0 in 0.486s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:44 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c" returned: 0 in 0.528s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:44 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13 Jul 17 07:11:45 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:45 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c Jul 17 07:11:45 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:45 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8da5753-4585-4733-9ec1-10431d415f13" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-quobyte-d8da5753-4585-4733-9ec1-10431d415f13" released by "delete_volume" :: held 0.826s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:45 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1869632-7f8b-479e-bd84-64c73b77304c" returned: 0 in 0.340s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-quobyte-e1869632-7f8b-479e-bd84-64c73b77304c" released by "delete_volume" :: held 0.945s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Created reservations ['12e7d3c1-8a36-4e08-b27d-5ddade18e7a6', '2dce69f7-2589-4fe5-97b8-4727434c523c', '07dab7ea-57d3-4bcc-89d7-f795126d7aa5', '6f54dca9-fb3a-4b1c-bbdd-a806c1390d1f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Created reservations ['70d9ae18-ee58-4e59-8992-25f3452857e4', 'b98d7834-c1cb-4c51-baff-55fd153555b2', 'b1648b6b-b553-44d6-b9ac-54aa13a75a46', '472af13b-8ab9-40c8-a613-cdfe5c67bae5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "cinder-2ccdbe37-b8fd-4757-bbab-52f7d98849e3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-2ccdbe37-b8fd-4757-bbab-52f7d98849e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:45 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:45 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "cinder-quobyte-2ccdbe37-b8fd-4757-bbab-52f7d98849e3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:11:45 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:45 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-quobyte-2ccdbe37-b8fd-4757-bbab-52f7d98849e3" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dadebf0-a198-4d82-b9d8-47bfcf0977f4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:45 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:45 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 Jul 17 07:11:45 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.394s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:45 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Deleted volume successfully. Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-43b6b62f-ee8a-4cf0-a429-32f61de888b7 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-d8da5753-4585-4733-9ec1-10431d415f13-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:46 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:46 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Deleted volume successfully. Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1a07aa52-d141-4a9d-a4ca-1d3cba776a4a tempest-VolumesTransfersV357Test-908001485 None] Lock "cinder-e1869632-7f8b-479e-bd84-64c73b77304c-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:46 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3" returned: 0 in 0.497s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:46 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3 Jul 17 07:11:46 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:46 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2ccdbe37-b8fd-4757-bbab-52f7d98849e3" returned: 0 in 0.370s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-quobyte-2ccdbe37-b8fd-4757-bbab-52f7d98849e3" released by "delete_volume" :: held 0.939s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Created reservations ['d5d0e8df-c02b-4bfe-9efa-eb93ad12a7bb', '254036a7-3835-4dc7-a83f-69840604b5ed', '5f23fda8-4243-4a2f-948f-e3a553e9e069', '4fd59242-d3f1-4cfd-a495-b8285ffbea27'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:46 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:11:46 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:47 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.326s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:11:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Deleted volume successfully. Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-250dd9d7-3dbb-4d40-a5a0-1967d4947663 tempest-TestServerVolumeAttachmentScenario-1537438780 None] Lock "cinder-2ccdbe37-b8fd-4757-bbab-52f7d98849e3-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Flow 'volume_create_manager' (405566d9-aaab-490e-b866-a97708099a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc5c2dc-00ca-4420-9ae7-722511821633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc5c2dc-00ca-4420-9ae7-722511821633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-248334621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9f8b19-254d-4592-80e3-c180bbb1be6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8d514b7b6a4d249a3b7ab94ff5ef0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:48Z,use_quota=True,user_id='a8e77ab57e2f4190af1ae39884a2f4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b24c516-40e0-4b7c-bfb2-1a10fc1f5fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b24c516-40e0-4b7c-bfb2-1a10fc1f5fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e686491a-a60f-4cd6-aa25-c7bfc883201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e686491a-a60f-4cd6-aa25-c7bfc883201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9f8b19-254d-4592-80e3-c180bbb1be6e', 'volume_name': 'volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf48f06-d4f3-48f2-a732-62c8ad916ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf48f06-d4f3-48f2-a732-62c8ad916ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447d3690-db8b-42fc-a42c-3933f7de88e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:48 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Volume 6d9f8b19-254d-4592-80e3-c180bbb1be6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e', 'volume_size': 1} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-248334621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9f8b19-254d-4592-80e3-c180bbb1be6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8d514b7b6a4d249a3b7ab94ff5ef0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:11:48Z,use_quota=True,user_id='a8e77ab57e2f4190af1ae39884a2f4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Creating volume 6d9f8b19-254d-4592-80e3-c180bbb1be6e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:11:48 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:48 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e 1073741824 Jul 17 07:11:48 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:48 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e 1073741824" returned: 0 in 0.604s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:11:48 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e Jul 17 07:11:48 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:11:48 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e" returned: 0 in 0.310s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447d3690-db8b-42fc-a42c-3933f7de88e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:48 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f9a145-11f2-4d33-8d86-6a27496c536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:11:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Volume volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e (6d9f8b19-254d-4592-80e3-c180bbb1be6e): created successfully Jul 17 07:11:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f9a145-11f2-4d33-8d86-6a27496c536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:11:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Flow 'volume_create_manager' (405566d9-aaab-490e-b866-a97708099a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:11:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f125aaa1-04ee-42d9-bfdb-1be7ee379d33 tempest-VolumesNegativeTest-2004802824 None] Created volume successfully. Jul 17 07:11:59 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=133,cinder:INSERT=46,cinder:UPDATE=152,cinder:DELETE=13 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:11:59 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=139,cinder:INSERT=37,cinder:UPDATE=153,cinder:DELETE=11 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Flow 'volume_create_manager' (8d4af4d7-e50d-4e7c-af0e-f5c54c4bb6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cca0c4-7b6c-4ec2-aa24-c265f11b33de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cca0c4-7b6c-4ec2-aa24-c265f11b33de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-166235270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531a1eff-a856-47ea-9b33-38602f8826b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e535a3ffcc34bb4a2cab500f48e531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:10Z,use_quota=True,user_id='a326e9d006264e94ba147086de3db2ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f11eff-b2f3-4cdf-b9d7-dbc10505b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f11eff-b2f3-4cdf-b9d7-dbc10505b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6137186-82f3-4673-ab94-1a21e3aa4762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6137186-82f3-4673-ab94-1a21e3aa4762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531a1eff-a856-47ea-9b33-38602f8826b4', 'volume_name': 'volume-531a1eff-a856-47ea-9b33-38602f8826b4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8465907c-cac4-41d6-89c9-262bf0a12027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8465907c-cac4-41d6-89c9-262bf0a12027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6a8843-85fb-45b7-9ecb-233fd667736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Volume 531a1eff-a856-47ea-9b33-38602f8826b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531a1eff-a856-47ea-9b33-38602f8826b4', 'volume_size': 1} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-166235270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531a1eff-a856-47ea-9b33-38602f8826b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e535a3ffcc34bb4a2cab500f48e531b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:10Z,use_quota=True,user_id='a326e9d006264e94ba147086de3db2ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Creating volume 531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:12:10 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:12:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:10 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 1073741824 Jul 17 07:12:10 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:11 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 1073741824" returned: 0 in 0.647s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:11 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:12:11 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:11 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.406s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6a8843-85fb-45b7-9ecb-233fd667736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531a1eff-a856-47ea-9b33-38602f8826b4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b232b2d-bec1-4eff-8432-ffa2e0f7af54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:11 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Volume volume-531a1eff-a856-47ea-9b33-38602f8826b4 (531a1eff-a856-47ea-9b33-38602f8826b4): created successfully Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b232b2d-bec1-4eff-8432-ffa2e0f7af54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Flow 'volume_create_manager' (8d4af4d7-e50d-4e7c-af0e-f5c54c4bb6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-245d4fee-fb03-4800-8346-7193fc4deb8d tempest-VolumesActionsTest-341370839 None] Created volume successfully. Jul 17 07:12:21 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:12:21 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:12:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Acquiring lock "cinder-6d9f8b19-254d-4592-80e3-c180bbb1be6e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Lock "cinder-6d9f8b19-254d-4592-80e3-c180bbb1be6e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Acquiring lock "cinder-quobyte-6d9f8b19-254d-4592-80e3-c180bbb1be6e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Lock "cinder-quobyte-6d9f8b19-254d-4592-80e3-c180bbb1be6e" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[582adf44-c0eb-4c54-9421-a1275b09155e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:28 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e Jul 17 07:12:28 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:28 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e" returned: 0 in 0.488s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:28 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e Jul 17 07:12:28 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:28 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d9f8b19-254d-4592-80e3-c180bbb1be6e" returned: 0 in 0.286s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Lock "cinder-quobyte-6d9f8b19-254d-4592-80e3-c180bbb1be6e" released by "delete_volume" :: held 0.837s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Created reservations ['3b995128-d07b-4436-adc0-81504651a8de', '6089315c-2bf7-4090-8a7f-3f298a9e7482', '174cce87-2e75-403c-b2d1-c6a51c46d8f4', 'b93cd309-6a87-4811-9b93-086c6693c41d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:28 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:12:28 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:29 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.310s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:12:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Deleted volume successfully. Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f481c085-255b-458c-8d10-0ae06093e4ad tempest-VolumesNegativeTest-2004802824 None] Lock "cinder-6d9f8b19-254d-4592-80e3-c180bbb1be6e-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:29 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:12:29 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:30 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.355s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:12:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:12:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:12:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:12:36 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:12:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Flow 'volume_create_manager' (3fbfefd8-0fe0-41e6-8e23-5a0072926a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcb8b04-84e0-48bd-9263-a5c25299c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcb8b04-84e0-48bd-9263-a5c25299c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-555274144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff47e68-0f26-4a70-a8f2-81ca1e06333f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f9542d115c4048b08b3df7101a0b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:37Z,use_quota=True,user_id='42a3a4fb72df47378e67c3c80322c561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa15364c-3385-494c-a5b1-89c9fe1d0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa15364c-3385-494c-a5b1-89c9fe1d0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a31458-d523-4716-b118-7f9cec5d0f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a31458-d523-4716-b118-7f9cec5d0f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff47e68-0f26-4a70-a8f2-81ca1e06333f', 'volume_name': 'volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d20396-312a-4ac7-8019-50a084b24578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d20396-312a-4ac7-8019-50a084b24578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e479153f-65de-4070-9dbb-1cc7df4b4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:37 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Volume eff47e68-0f26-4a70-a8f2-81ca1e06333f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f', 'volume_size': 1} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-555274144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff47e68-0f26-4a70-a8f2-81ca1e06333f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f9542d115c4048b08b3df7101a0b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:37Z,use_quota=True,user_id='42a3a4fb72df47378e67c3c80322c561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Creating volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:12:37 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:37 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f 1073741824 Jul 17 07:12:37 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:37 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f 1073741824" returned: 0 in 0.870s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:38 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f Jul 17 07:12:38 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:38 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f" returned: 0 in 0.475s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e479153f-65de-4070-9dbb-1cc7df4b4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94ba709-3871-48f6-90b0-b83ed65409f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:38 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Volume volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f (eff47e68-0f26-4a70-a8f2-81ca1e06333f): created successfully Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94ba709-3871-48f6-90b0-b83ed65409f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Flow 'volume_create_manager' (3fbfefd8-0fe0-41e6-8e23-5a0072926a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ed8fa908-edf1-481a-b3e0-eb9dc9a849f9 tempest-VolumesSnapshotListTestJSON-2044880961 None] Created volume successfully. Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Creating offline snapshot 7708615e-4e0a-433e-b423-7599edce0aaf of volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec42c9-b1be-446b-9970-ed77d126ea9b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-24715ce7-6f9c-4233-abf1-161212e9308b tempest-VolumesActionsTest-341370839 None] Acquiring lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4" by "attach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-24715ce7-6f9c-4233-abf1-161212e9308b tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4" acquired by "attach_volume" :: waited 0.050s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:39 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f Jul 17 07:12:39 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-24715ce7-6f9c-4233-abf1-161212e9308b tempest-VolumesActionsTest-341370839 None] Attaching volume 531a1eff-a856-47ea-9b33-38602f8826b4 to instance 767590d0-cc1f-40c2-b468-6b8503c1dd5b at mountpoint /dev/vdb on host None. Jul 17 07:12:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-24715ce7-6f9c-4233-abf1-161212e9308b tempest-VolumesActionsTest-341370839 None] Attach volume completed successfully. Jul 17 07:12:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-24715ce7-6f9c-4233-abf1-161212e9308b tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4" released by "attach_volume" :: held 0.159s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4b8bf836-5d4a-4295-bee4-8eeefe734922 tempest-VolumesActionsTest-341370839 None] Acquiring lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-detach_volume" by "detach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4b8bf836-5d4a-4295-bee4-8eeefe734922 tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4b8bf836-5d4a-4295-bee4-8eeefe734922 tempest-VolumesActionsTest-341370839 None] Detaching volume 531a1eff-a856-47ea-9b33-38602f8826b4 from instance 767590d0-cc1f-40c2-b468-6b8503c1dd5b. Jul 17 07:12:40 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f" returned: 0 in 0.860s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:40 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf 1G Jul 17 07:12:40 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4b8bf836-5d4a-4295-bee4-8eeefe734922 tempest-VolumesActionsTest-341370839 None] Detach volume completed successfully. Jul 17 07:12:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4b8bf836-5d4a-4295-bee4-8eeefe734922 tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:41 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf 1G" returned: 0 in 0.835s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:41 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:12:41 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Flow 'volume_create_manager' (f77a14a9-8964-43ab-b49a-90f50a150c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2340cc5e-677b-4040-9aba-647d8c597f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:41 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.513s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:41 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf is being set with open permissions: ugo+rw Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2340cc5e-677b-4040-9aba-647d8c597f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1311219569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb25901-79b5-42b1-867d-3cc259952c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265346101a84df29dec87be7649503d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:42Z,use_quota=True,user_id='4e39e4ebee2b45a98b5e8039a25a5c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:41 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274ca34b-bbfb-4d69-bb7e-a122075f33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:41 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274ca34b-bbfb-4d69-bb7e-a122075f33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4276b9d9-c218-4c5f-8fdb-e9597124a45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:41 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:12:42 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.338s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:42 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info Jul 17 07:12:42 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4276b9d9-c218-4c5f-8fdb-e9597124a45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddb25901-79b5-42b1-867d-3cc259952c38', 'volume_name': 'volume-ddb25901-79b5-42b1-867d-3cc259952c38', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7013a3-08da-43f9-a170-6c681544f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7013a3-08da-43f9-a170-6c681544f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639d009b-a8d9-4767-b52f-9f7768710fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Volume ddb25901-79b5-42b1-867d-3cc259952c38: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddb25901-79b5-42b1-867d-3cc259952c38', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Trying to clone ddb25901-79b5-42b1-867d-3cc259952c38 from image d615f633-2881-4d59-aa2e-ff4db61859d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:12:42 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info" returned: 0 in 0.537s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:42 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info is being set with open permissions: ugo+rw Jul 17 07:12:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:42 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info Jul 17 07:12:42 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:12:43 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Image download 20.69 MB at 20.69 MB/s Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32c757-d7ed-4418-9f20-708e2f660853]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:43 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.info" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.673s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-17306de6-638b-4066-bb5d-3c83eb8a0766 tempest-VolumesSnapshotListTestJSON-2044880961 None] Create snapshot completed successfully Jul 17 07:12:43 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD Jul 17 07:12:43 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:43 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 is fetched for user 4e39e4ebee2b45a98b5e8039a25a5c58. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2cd4f4-c2fa-493f-af3a-448530f11910]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:43 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD Jul 17 07:12:43 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:44 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1311219569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb25901-79b5-42b1-867d-3cc259952c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265346101a84df29dec87be7649503d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:42Z,use_quota=True,user_id='4e39e4ebee2b45a98b5e8039a25a5c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Creating volume ddb25901-79b5-42b1-867d-3cc259952c38 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:12:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:44 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 1073741824 Jul 17 07:12:44 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:44 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 1073741824" returned: 0 in 0.557s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:44 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 Jul 17 07:12:44 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:44 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38" returned: 0 in 0.346s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:12:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.889s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Creating offline snapshot 3078444d-9216-4f8d-b549-0ef3fd297d07 of volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Attempting download of d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume ddb25901-79b5-42b1-867d-3cc259952c38. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8984217f-f417-4c10-aaed-3008d888af2c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b933a5ea-1b2f-4ad9-b932-b18e1575de46]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:45 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:12:45 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:45 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg Jul 17 07:12:45 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:45 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:45 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.726s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:45 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg Jul 17 07:12:45 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:12:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:45 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 1G Jul 17 07:12:45 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:46 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg" returned: 1 in 0.559s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d615f633-2881-4d59-aa2e-ff4db61859d1_6hczzlgg' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[379824d9-10a9-4f77-9f21-6157303fd171]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:46 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD Jul 17 07:12:46 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:46 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 1G" returned: 0 in 0.651s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:46 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:12:46 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:46 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] d615f633-2881-4d59-aa2e-ff4db61859d1 was qcow2, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:46 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 Jul 17 07:12:46 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:46 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:46 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 is being set with open permissions: ugo+rw Jul 17 07:12:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:46 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:12:46 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:47 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.399s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b7c998b3-69b8-41e1-8127-16dac9bca49c tempest-VolumesSnapshotListTestJSON-2044880961 None] Create snapshot completed successfully Jul 17 07:12:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Creating offline snapshot a217767d-e040-4fe9-8338-31d06895fb85 of volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:12:48 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d2950-9fa9-4d6f-a3ea-ea4bc2aef335]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:48 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:12:48 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:49 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.543s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:12:49 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38" returned: 0 in 2.653s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d615f633-2881-4d59-aa2e-ff4db61859d1_ayt1k08zdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:12:49 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Converted 112.00 MB image at 42.12 MB/s Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:49 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 1G Jul 17 07:12:49 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:49 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 1G Jul 17 07:12:49 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Flow 'volume_create_manager' (829eedde-fc9d-48d5-ac84-4893ffd72bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df6992d-33e1-4230-9aaa-fb4d73fd673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df6992d-33e1-4230-9aaa-fb4d73fd673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-549318887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305b8410-025c-4043-aec4-f5602a75042e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b514bbfa1d4b432c9b54cf7917faafcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:49Z,use_quota=True,user_id='65858f18a90240dcb4c1ab4409f4b753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf83aff7-ee08-49fd-a051-fd4cd85287b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf83aff7-ee08-49fd-a051-fd4cd85287b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae278c63-eeec-45d4-a151-4804b6fef2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae278c63-eeec-45d4-a151-4804b6fef2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305b8410-025c-4043-aec4-f5602a75042e', 'volume_name': 'volume-305b8410-025c-4043-aec4-f5602a75042e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4c3703-9091-48d1-9ba9-016e80a94d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4c3703-9091-48d1-9ba9-016e80a94d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f6df42-c377-4e1f-82ed-49f510793223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Volume 305b8410-025c-4043-aec4-f5602a75042e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305b8410-025c-4043-aec4-f5602a75042e', 'volume_size': 1} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:49 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 1G" returned: 0 in 0.404s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Downloaded image d615f633-2881-4d59-aa2e-ff4db61859d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}])) to volume ddb25901-79b5-42b1-867d-3cc259952c38 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Temporary image d615f633-2881-4d59-aa2e-ff4db61859d1 for user 4e39e4ebee2b45a98b5e8039a25a5c58 is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Marking volume ddb25901-79b5-42b1-867d-3cc259952c38 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Copying metadata from image d615f633-2881-4d59-aa2e-ff4db61859d1 to ddb25901-79b5-42b1-867d-3cc259952c38. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Creating volume glance metadata for volume ddb25901-79b5-42b1-867d-3cc259952c38 backed by image d615f633-2881-4d59-aa2e-ff4db61859d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639d009b-a8d9-4767-b52f-9f7768710fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb25901-79b5-42b1-867d-3cc259952c38', 'volume_size': 1, 'image_id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d615f633-2881-4d59-aa2e-ff4db61859d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '577deedbf4f14814ada3a8bd3a1b34ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd615f633-2881-4d59-aa2e-ff4db61859d1', 'created_at': datetime.datetime(2026, 7, 17, 4, 56, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 4, 56, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d615f633-2881-4d59-aa2e-ff4db61859d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28219e6-f7da-41e5-929c-aaf508c74506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Volume volume-ddb25901-79b5-42b1-867d-3cc259952c38 (ddb25901-79b5-42b1-867d-3cc259952c38): created successfully Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28219e6-f7da-41e5-929c-aaf508c74506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Flow 'volume_create_manager' (f77a14a9-8964-43ab-b49a-90f50a150c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e0cdf044-4ef7-4c3d-8a37-654b98f3dd0e tempest-TestShelveInstance-1009785415 None] Created volume successfully. Jul 17 07:12:50 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 1G" returned: 0 in 0.719s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:50 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 Jul 17 07:12:50 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:50 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85" returned: 0 in 0.440s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:50 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 is being set with open permissions: ugo+rw Jul 17 07:12:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:50 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 Jul 17 07:12:50 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:50 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85" returned: 0 in 0.544s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-549318887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305b8410-025c-4043-aec4-f5602a75042e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b514bbfa1d4b432c9b54cf7917faafcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:12:49Z,use_quota=True,user_id='65858f18a90240dcb4c1ab4409f4b753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Creating volume 305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:12:51 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:12:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:51 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e 1073741824 Jul 17 07:12:51 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7b7438ab-e67d-4495-8b72-02b735cf9442 tempest-VolumesSnapshotListTestJSON-2044880961 None] Create snapshot completed successfully Jul 17 07:12:52 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e 1073741824" returned: 0 in 1.083s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:52 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:12:52 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:52 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.648s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:12:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f6df42-c377-4e1f-82ed-49f510793223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305b8410-025c-4043-aec4-f5602a75042e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9b80f3-5768-41bf-9daf-c74c5a898b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:12:53 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Volume volume-305b8410-025c-4043-aec4-f5602a75042e (305b8410-025c-4043-aec4-f5602a75042e): created successfully Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9b80f3-5768-41bf-9daf-c74c5a898b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Flow 'volume_create_manager' (829eedde-fc9d-48d5-ac84-4893ffd72bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:12:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-70655dea-da75-40e6-a7f0-8cb330d92a90 tempest-TestStampPattern-157287600 None] Created volume successfully. Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-a217767d-e040-4fe9-8338-31d06895fb85-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-a217767d-e040-4fe9-8338-31d06895fb85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-a217767d-e040-4fe9-8338-31d06895fb85" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-a217767d-e040-4fe9-8338-31d06895fb85" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Deleting offline snapshot a217767d-e040-4fe9-8338-31d06895fb85 of volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:12:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] snapshot_file for this snap is: volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:12:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d3fee2-7f17-4b5b-a33c-eca0271e9357]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:54 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 Jul 17 07:12:54 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:54 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85" returned: 0 in 0.486s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:12:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fce2896-06cf-4a44-b48f-f90baecb5b1d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:54 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:12:54 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:55 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.906s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:12:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:55 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 Jul 17 07:12:55 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-3efb03e2-e4f8-4bdf-a826-b647b0284da4 req-c614e4c2-836c-4479-808f-7ae0daed3011 tempest-TestShelveInstance-1009785415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-3efb03e2-e4f8-4bdf-a826-b647b0284da4 req-c614e4c2-836c-4479-808f-7ae0daed3011 tempest-TestShelveInstance-1009785415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-3efb03e2-e4f8-4bdf-a826-b647b0284da4 req-c614e4c2-836c-4479-808f-7ae0daed3011 tempest-TestShelveInstance-1009785415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98ef2267-7f93-4357-934a-80baeaf92642 tempest-VolumesActionsTest-341370839 None] Acquiring lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4" by "attach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98ef2267-7f93-4357-934a-80baeaf92642 tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4" acquired by "attach_volume" :: waited 0.047s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-3efb03e2-e4f8-4bdf-a826-b647b0284da4 req-c614e4c2-836c-4479-808f-7ae0daed3011 tempest-TestShelveInstance-1009785415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-ddb25901-79b5-42b1-867d-3cc259952c38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9898a62d-d4f1-40c6-a1bf-ab5f2b6c2b86', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:12:56 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85" returned: 0 in 0.866s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:56 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85 Jul 17 07:12:56 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-98ef2267-7f93-4357-934a-80baeaf92642 tempest-VolumesActionsTest-341370839 None] Attaching volume 531a1eff-a856-47ea-9b33-38602f8826b4 to instance 69885ac5-b37a-4b0a-ab73-2f78897c43d6 at mountpoint /dev/vdb on host None. Jul 17 07:12:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-3efb03e2-e4f8-4bdf-a826-b647b0284da4 req-c614e4c2-836c-4479-808f-7ae0daed3011 tempest-TestShelveInstance-1009785415 None] attachment_update completed successfully. Jul 17 07:12:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-98ef2267-7f93-4357-934a-80baeaf92642 tempest-VolumesActionsTest-341370839 None] Attach volume completed successfully. Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-98ef2267-7f93-4357-934a-80baeaf92642 tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4" released by "attach_volume" :: held 0.376s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:56 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.a217767d-e040-4fe9-8338-31d06895fb85" returned: 0 in 0.626s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-a217767d-e040-4fe9-8338-31d06895fb85" released by "_delete_snapshot" :: held 3.066s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" released by "delete_snapshot" :: held 3.101s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-97c7878d-cb04-4153-ad88-5a99a1849738 tempest-VolumesActionsTest-341370839 None] Acquiring lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-detach_volume" by "detach_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-97c7878d-cb04-4153-ad88-5a99a1849738 tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-97c7878d-cb04-4153-ad88-5a99a1849738 tempest-VolumesActionsTest-341370839 None] Detaching volume 531a1eff-a856-47ea-9b33-38602f8826b4 from instance 69885ac5-b37a-4b0a-ab73-2f78897c43d6. Jul 17 07:12:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Created reservations ['b13d21f3-015e-4c3b-af4c-41dd47a4dcf7', '7dea84fc-ba48-4bef-81e0-68fd92a3c40e', '0c5bfd9c-3e3c-4464-8797-fa0ca37a4fe6', '88595e78-dc64-40f3-b888-afd8acba12c2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:12:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-97c7878d-cb04-4153-ad88-5a99a1849738 tempest-VolumesActionsTest-341370839 None] Detach volume completed successfully. Jul 17 07:12:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-97c7878d-cb04-4153-ad88-5a99a1849738 tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Delete snapshot completed successfully. Jul 17 07:12:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55e509b1-65ca-4600-848c-af4742680ccf tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-a217767d-e040-4fe9-8338-31d06895fb85-delete_snapshot" released by "delete_snapshot" :: held 3.465s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-3078444d-9216-4f8d-b549-0ef3fd297d07-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-3078444d-9216-4f8d-b549-0ef3fd297d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-3078444d-9216-4f8d-b549-0ef3fd297d07" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-3078444d-9216-4f8d-b549-0ef3fd297d07" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Deleting offline snapshot 3078444d-9216-4f8d-b549-0ef3fd297d07 of volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] snapshot_file for this snap is: volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddfb52a-3a74-4f6d-8b94-8af043304f31]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:58 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:12:58 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:59 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.707s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b803d86-5b79-4f2f-844c-1d35f6107990]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:12:59 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:12:59 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:12:59 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.606s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:12:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:00 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:13:00 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:00 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.608s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:00 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07 Jul 17 07:13:00 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:00 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.3078444d-9216-4f8d-b549-0ef3fd297d07" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-3078444d-9216-4f8d-b549-0ef3fd297d07" released by "_delete_snapshot" :: held 2.533s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" released by "delete_snapshot" :: held 2.574s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Created reservations ['9909df12-81a9-4884-a0c9-459eb1f6d897', '7d45d30b-66bb-46b3-9e56-19976ca2ed33', 'faf63cc6-96a0-49e7-ac1a-57e63d1b78b5', 'c2da80ef-b231-4a90-a587-07beefd72850'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:13:01 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Delete snapshot completed successfully. Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-895fa52e-44e0-41cc-97b9-81bc670f9e19 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-3078444d-9216-4f8d-b549-0ef3fd297d07-delete_snapshot" released by "delete_snapshot" :: held 2.783s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-7708615e-4e0a-433e-b423-7599edce0aaf-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-7708615e-4e0a-433e-b423-7599edce0aaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-7708615e-4e0a-433e-b423-7599edce0aaf" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-7708615e-4e0a-433e-b423-7599edce0aaf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Deleting offline snapshot 7708615e-4e0a-433e-b423-7599edce0aaf of volume eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] snapshot_file for this snap is: volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8420fd-1c4c-44c9-8500-c18de603df1a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:02 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:13:02 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:02 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.702s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:13:02 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3688f-a723-4232-a34a-d37f07267fb1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:03 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f Jul 17 07:13:03 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:03 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f" returned: 0 in 0.717s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:03 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:13:03 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:04 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.660s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:04 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf Jul 17 07:13:04 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:04 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f.7708615e-4e0a-433e-b423-7599edce0aaf" returned: 0 in 0.416s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-7708615e-4e0a-433e-b423-7599edce0aaf" released by "_delete_snapshot" :: held 2.855s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" released by "delete_snapshot" :: held 2.899s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:04 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Created reservations ['222d80b0-e46f-46df-a33e-b03e7ba77372', '55d3e8dd-9502-4620-86d5-56350f46391b', '7ed0ae68-eb30-4832-86e0-62524742778a', '8dc8a1ea-9cd4-4bbf-ab44-d46148da126f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:13:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Delete snapshot completed successfully. Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d5e47c03-ab5d-4fae-9b97-c367e3ceeae0 tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-7708615e-4e0a-433e-b423-7599edce0aaf-delete_snapshot" released by "delete_snapshot" :: held 3.323s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-eff47e68-0f26-4a70-a8f2-81ca1e06333f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-eff47e68-0f26-4a70-a8f2-81ca1e06333f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5998f3-20a8-409f-8dd8-f53938ee5e26]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" acquired by "delete_volume" :: waited 0.050s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50bc621-3212-442f-91e1-03e9f6ef5121]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:05 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:13:05 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:06 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f Jul 17 07:13:06 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:06 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.854s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6431fc1-ca82-4217-99af-9e5d5bb4c2fe]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:06 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f" returned: 0 in 0.905s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:06 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:13:06 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:06 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f Jul 17 07:13:06 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:07 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 1.096s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.afeef6e1-5daf-4e8e-85d4-834b61697962gcaso1z0.img {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:07 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.afeef6e1-5daf-4e8e-85d4-834b61697962gcaso1z0.img Jul 17 07:13:07 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:07 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-eff47e68-0f26-4a70-a8f2-81ca1e06333f" returned: 0 in 0.825s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-quobyte-eff47e68-0f26-4a70-a8f2-81ca1e06333f" released by "delete_volume" :: held 1.924s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Created reservations ['2c1a560e-c2c1-4073-ad94-6cf73f31a426', 'cf4eeac3-2e5e-453e-9bb8-7550f76c9a7a', '11cb88ac-672e-4ae4-bf5b-ade7c8cb3cf8', '4acddbf8-ba02-433a-9b87-d94d9b9f72fa'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:13:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:08 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:13:08 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:09 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 1.267s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:09 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:13:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Deleted volume successfully. Jul 17 07:13:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-08ba02d8-3c74-4f65-8eff-b32fca1416dc tempest-VolumesSnapshotListTestJSON-2044880961 None] Lock "cinder-eff47e68-0f26-4a70-a8f2-81ca1e06333f-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:13:17 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.afeef6e1-5daf-4e8e-85d4-834b61697962gcaso1z0.img" returned: 0 in 10.095s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f856eb-0ad8-4adb-8a36-8f18cc1e49c9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:17 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:13:17 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:17 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=72,cinder:INSERT=23,cinder:UPDATE=46,cinder:DELETE=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:13:18 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.832s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:18 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4, size 1024.00 MB, duration 10.10 sec, destination /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.afeef6e1-5daf-4e8e-85d4-834b61697962gcaso1z0.img {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:13:18 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Converted 1024.00 MB image at 101.41 MB/s Jul 17 07:13:18 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] afeef6e1-5daf-4e8e-85d4-834b61697962 was raw, no need to convert to raw {{(pid=87331) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 17 07:13:28 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=63,cinder:SELECT=63,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:13:28 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b1511fe7-3b1a-4a3f-8297-434ae0690596 req-54462e8a-2351-4250-9842-ea19be4e3a5e tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:13:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:29 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:13:29 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:30 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.425s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:13:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:13:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:13:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:13:39 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=2 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:13:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-c4801392-8bda-4e67-b313-9ff63b7a68c7 req-97f7c4fb-2067-4d6f-81b2-a1192c0eaa4f tempest-TestShelveInstance-1009785415 None] Terminate volume connection completed successfully. Jul 17 07:13:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-c4801392-8bda-4e67-b313-9ff63b7a68c7 req-97f7c4fb-2067-4d6f-81b2-a1192c0eaa4f tempest-TestShelveInstance-1009785415 None] Deleting attachment 9898a62d-d4f1-40c6-a1bf-ab5f2b6c2b86. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:13:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-4efb73a6-008e-4c75-a82a-0b3723528fa4 req-64bfb023-b662-4f7e-b437-309ef7f38c43 tempest-TestShelveInstance-1009785415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.415s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Uploaded volume to glance image-id: afeef6e1-5daf-4e8e-85d4-834b61697962. {{(pid=87331) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b1511fe7-3b1a-4a3f-8297-434ae0690596 req-54462e8a-2351-4250-9842-ea19be4e3a5e tempest-TestStampPattern-157287600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.810s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b1511fe7-3b1a-4a3f-8297-434ae0690596 req-54462e8a-2351-4250-9842-ea19be4e3a5e tempest-TestStampPattern-157287600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-4efb73a6-008e-4c75-a82a-0b3723528fa4 req-64bfb023-b662-4f7e-b437-309ef7f38c43 tempest-TestShelveInstance-1009785415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.254s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:13:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e25b2ad2-daaf-43dd-81e0-0f2c275c4eaa tempest-VolumesActionsTest-341370839 None] Copy volume to image completed successfully. Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-4efb73a6-008e-4c75-a82a-0b3723528fa4 req-64bfb023-b662-4f7e-b437-309ef7f38c43 tempest-TestShelveInstance-1009785415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-b1511fe7-3b1a-4a3f-8297-434ae0690596 req-54462e8a-2351-4250-9842-ea19be4e3a5e tempest-TestStampPattern-157287600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-305b8410-025c-4043-aec4-f5602a75042e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6d25d00-ce0a-465e-9dfc-600256f062b9', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:13:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-4efb73a6-008e-4c75-a82a-0b3723528fa4 req-64bfb023-b662-4f7e-b437-309ef7f38c43 tempest-TestShelveInstance-1009785415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-ddb25901-79b5-42b1-867d-3cc259952c38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc00735d-928f-4603-aa20-236f82918537', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:13:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-4efb73a6-008e-4c75-a82a-0b3723528fa4 req-64bfb023-b662-4f7e-b437-309ef7f38c43 tempest-TestShelveInstance-1009785415 None] attachment_update completed successfully. Jul 17 07:13:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-b1511fe7-3b1a-4a3f-8297-434ae0690596 req-54462e8a-2351-4250-9842-ea19be4e3a5e tempest-TestStampPattern-157287600 None] attachment_update completed successfully. Jul 17 07:13:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:13:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7014b2-dc74-45b7-9390-2f82146e857b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:46 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:13:46 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:47 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.473s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:47 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e3b80-7759-4249-96f4-9491205b4127]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:47 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:13:47 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:47 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.589s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:47 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img Jul 17 07:13:47 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-29ffa0df-b525-4189-958f-4c5b7b39e416 req-98b180ad-a18a-43a7-9c5f-97eace720a64 tempest-TestStampPattern-157287600 None] Terminate volume connection completed successfully. Jul 17 07:13:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-29ffa0df-b525-4189-958f-4c5b7b39e416 req-98b180ad-a18a-43a7-9c5f-97eace720a64 tempest-TestStampPattern-157287600 None] Deleting attachment f6d25d00-ce0a-465e-9dfc-600256f062b9. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:13:55 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:13:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:13:55 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img" returned: 0 in 8.206s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34024c4-7e1e-4ea7-bc56-39aea12063dd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:56 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:13:56 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:56 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.990s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:56 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:13:56 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Converted 1024.00 MB image at 124.77 MB/s Jul 17 07:13:56 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] 3a164cbb-9af4-428e-8bd2-15bd66ede1f6 was raw, converting to qcow2 {{(pid=87331) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 17 07:13:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5cb32c-c9ea-47e9-9ee6-f3d3cc85d34b]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:57 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img Jul 17 07:13:57 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:57 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img" returned: 0 in 0.460s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:57 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img Jul 17 07:13:57 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:57 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img" returned: 1 in 0.454s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:13:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img /opt/stack/data/cinder/conversion/vol_upload_854qsl6t {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:57 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img /opt/stack/data/cinder/conversion/vol_upload_854qsl6t Jul 17 07:13:57 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:58 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img /opt/stack/data/cinder/conversion/vol_upload_854qsl6t" returned: 0 in 0.361s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:13:58 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Image conversion details: src /opt/stack/data/cinder/conversion/531a1eff-a856-47ea-9b33-38602f8826b4.temp_image.3a164cbb-9af4-428e-8bd2-15bd66ede1f67rwdj_jk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_854qsl6t {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:13:58 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 17 07:13:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[518cda68-37f6-438a-a6ae-2829e7157196]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:13:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_854qsl6t {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:13:58 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_854qsl6t Jul 17 07:13:58 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:13:58 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 17 07:13:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_854qsl6t" returned: 0 in 0.463s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.697s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Uploaded volume to glance image-id: 3a164cbb-9af4-428e-8bd2-15bd66ede1f6. {{(pid=87331) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.384s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Creating offline snapshot 5fe8b119-457e-4261-8530-51abf183cb09 of volume 305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:14:01 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-35f27741-b54a-428a-9e6f-fb80ce3e7c0b tempest-VolumesActionsTest-341370839 None] Copy volume to image completed successfully. Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[640a539d-0563-43fe-a779-39f9b7ac692f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:01 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:14:01 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:01 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.543s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:01 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 1G Jul 17 07:14:01 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:02 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 1G" returned: 0 in 0.598s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305b8410-025c-4043-aec4-f5602a75042e -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:02 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305b8410-025c-4043-aec4-f5602a75042e -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 Jul 17 07:14:02 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:03 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305b8410-025c-4043-aec4-f5602a75042e -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09" returned: 0 in 0.547s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:03 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 is being set with open permissions: ugo+rw Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:03 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 Jul 17 07:14:03 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Acquiring lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Acquiring lock "cinder-quobyte-531a1eff-a856-47ea-9b33-38602f8826b4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Lock "cinder-quobyte-531a1eff-a856-47ea-9b33-38602f8826b4" acquired by "delete_volume" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac16d7-09b7-4b42-a39e-5c702bd9ffe4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:03 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:03 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info Jul 17 07:14:03 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:03 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:14:03 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:03 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info" returned: 0 in 0.328s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:03 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info is being set with open permissions: ugo+rw Jul 17 07:14:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:03 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info Jul 17 07:14:03 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:04 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.756s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:04 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4 Jul 17 07:14:04 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:04 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.info" returned: 0 in 0.470s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.098s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:04 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dd2a9efd-4766-421c-a344-ca7a8c42850f tempest-TestStampPattern-157287600 None] Create snapshot completed successfully Jul 17 07:14:04 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-531a1eff-a856-47ea-9b33-38602f8826b4" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Lock "cinder-quobyte-531a1eff-a856-47ea-9b33-38602f8826b4" released by "delete_volume" :: held 1.271s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Created reservations ['c777f183-a7ff-48b6-acaf-8c17a56e41b3', 'b2423f62-e72d-418f-8fb0-56b3e4fe29b4', 'd988284e-52b5-4e41-9a27-eaa5dbe817c1', 'fc308a76-3b33-4610-b783-cce817c794a1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:04 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:14:04 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:05 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:14:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Deleted volume successfully. Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0ade9ac-61b2-4e31-9709-62a29c805a4d tempest-VolumesActionsTest-341370839 None] Lock "cinder-531a1eff-a856-47ea-9b33-38602f8826b4-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Flow 'volume_create_manager' (08b04de0-fa5d-43ab-bf1f-79ce7aed71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938af25-deba-478e-9f64-3973c9511863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e938af25-deba-478e-9f64-3973c9511863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-363989014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f5f488-b9d0-4edd-b5c5-aa1e23071804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c996c920204422854c7729aa9f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:05Z,use_quota=True,user_id='82efecbed84f4886a56a07d21125b0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87ba0ac-549e-46ed-b393-3644a3256d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87ba0ac-549e-46ed-b393-3644a3256d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84872aa4-d1dc-491d-a742-d755f7a6379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84872aa4-d1dc-491d-a742-d755f7a6379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f5f488-b9d0-4edd-b5c5-aa1e23071804', 'volume_name': 'volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25151fe-03ab-40e7-992a-e92e063a763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25151fe-03ab-40e7-992a-e92e063a763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953c85a4-043c-43ab-a26b-57e7caf5f085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Volume 66f5f488-b9d0-4edd-b5c5-aa1e23071804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804', 'volume_size': 1} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-363989014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f5f488-b9d0-4edd-b5c5-aa1e23071804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c996c920204422854c7729aa9f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:05Z,use_quota=True,user_id='82efecbed84f4886a56a07d21125b0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Creating volume 66f5f488-b9d0-4edd-b5c5-aa1e23071804 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:14:05 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:14:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:05 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 1073741824 Jul 17 07:14:05 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:06 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 1073741824" returned: 0 in 0.928s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:06 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 Jul 17 07:14:06 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:07 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804" returned: 0 in 0.460s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953c85a4-043c-43ab-a26b-57e7caf5f085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e69f92-261b-4ae7-a594-7cd6ebda6dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Volume volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 (66f5f488-b9d0-4edd-b5c5-aa1e23071804): created successfully Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e69f92-261b-4ae7-a594-7cd6ebda6dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Flow 'volume_create_manager' (08b04de0-fa5d-43ab-bf1f-79ce7aed71d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-973150cb-dbe7-4787-80c6-48e500f3e2bd tempest-TestMinimumBasicScenario-1859170804 None] Created volume successfully. Jul 17 07:14:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-d7d7ce29-f574-4ef0-81b2-696ba5f94890 req-96247cbf-a444-4f8f-aaf2-184e7eceb926 tempest-TestMinimumBasicScenario-1859170804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-d7d7ce29-f574-4ef0-81b2-696ba5f94890 req-96247cbf-a444-4f8f-aaf2-184e7eceb926 tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-d7d7ce29-f574-4ef0-81b2-696ba5f94890 req-96247cbf-a444-4f8f-aaf2-184e7eceb926 tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-d7d7ce29-f574-4ef0-81b2-696ba5f94890 req-96247cbf-a444-4f8f-aaf2-184e7eceb926 tempest-TestMinimumBasicScenario-1859170804 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44af0fbc-5866-4af3-bae5-6d36eea6ce3b', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:14:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-d7d7ce29-f574-4ef0-81b2-696ba5f94890 req-96247cbf-a444-4f8f-aaf2-184e7eceb926 tempest-TestMinimumBasicScenario-1859170804 None] attachment_update completed successfully. Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Flow 'volume_create_manager' (a6de82f9-0791-41a1-b2b2-c4684df029d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833fd808-1647-4db7-b187-002f4da59dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Flow 'volume_create_manager' (54f1f607-e622-43e4-b468-256a28b293c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202c4f37-36b3-4c8d-8bec-9d70ad72e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833fd808-1647-4db7-b187-002f4da59dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-206362262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cedc07e-5577-4e5d-ba40-4c6e1687c776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b514bbfa1d4b432c9b54cf7917faafcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fe8b119-457e-4261-8530-51abf183cb09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:18Z,use_quota=True,user_id='65858f18a90240dcb4c1ab4409f4b753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6248b34-0fd9-40f8-8348-4cdc4f3ce2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6248b34-0fd9-40f8-8348-4cdc4f3ce2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d201e0-22b2-4ce7-9251-4470c19cd414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d201e0-22b2-4ce7-9251-4470c19cd414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6cedc07e-5577-4e5d-ba40-4c6e1687c776', 'volume_name': 'volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776', 'volume_size': 1, 'snapshot_id': '5fe8b119-457e-4261-8530-51abf183cb09'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d0967c-4bac-43c6-9dfe-6c503464d3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d0967c-4bac-43c6-9dfe-6c503464d3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4937d2-a485-4412-b2e6-2b1a5384dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Volume 6cedc07e-5577-4e5d-ba40-4c6e1687c776: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776', 'volume_size': 1, 'snapshot_id': '5fe8b119-457e-4261-8530-51abf183cb09'} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202c4f37-36b3-4c8d-8bec-9d70ad72e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1129623510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c379fa-714d-430e-9be6-9c358c0add70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6c27163d304cbe826d084e26d54a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:18Z,use_quota=True,user_id='b5e9db7a387c494f82eaf4ade5815d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e8c532-0122-470d-915e-233c7cd59b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e8c532-0122-470d-915e-233c7cd59b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fccaf3-fe72-4296-af0f-fb3132f06b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fccaf3-fe72-4296-af0f-fb3132f06b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c379fa-714d-430e-9be6-9c358c0add70', 'volume_name': 'volume-05c379fa-714d-430e-9be6-9c358c0add70', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d93623-34b2-4bb8-b092-02923a6170e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d93623-34b2-4bb8-b092-02923a6170e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8693662f-f19f-4d6c-9326-a32fa4a0e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Volume 05c379fa-714d-430e-9be6-9c358c0add70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c379fa-714d-430e-9be6-9c358c0add70', 'volume_size': 1} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1129623510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c379fa-714d-430e-9be6-9c358c0add70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6c27163d304cbe826d084e26d54a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:18Z,use_quota=True,user_id='b5e9db7a387c494f82eaf4ade5815d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Creating volume 05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:14:18 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:18 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 1073741824 Jul 17 07:14:18 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:18 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 1073741824" returned: 0 in 0.584s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:19 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:19 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:19 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 0.321s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.947s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-quobyte-5fe8b119-457e-4261-8530-51abf183cb09-6cedc07e-5577-4e5d-ba40-4c6e1687c776" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8693662f-f19f-4d6c-9326-a32fa4a0e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c379fa-714d-430e-9be6-9c358c0add70', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8585afb2-fa2a-4a7d-aa8e-d1a3830533ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-5fe8b119-457e-4261-8530-51abf183cb09-6cedc07e-5577-4e5d-ba40-4c6e1687c776" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Creating volume 6cedc07e-5577-4e5d-ba40-4c6e1687c776 from snapshot 5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-quobyte-6cedc07e-5577-4e5d-ba40-4c6e1687c776" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Volume volume-05c379fa-714d-430e-9be6-9c358c0add70 (05c379fa-714d-430e-9be6-9c358c0add70): created successfully Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8585afb2-fa2a-4a7d-aa8e-d1a3830533ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Flow 'volume_create_manager' (54f1f607-e622-43e4-b468-256a28b293c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-6cedc07e-5577-4e5d-ba40-4c6e1687c776" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] snapshot: 5fe8b119-457e-4261-8530-51abf183cb09, volume: 6cedc07e-5577-4e5d-ba40-4c6e1687c776, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:14:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-68b7ea25-85e0-4c75-a086-1c2d4429f490 tempest-VolumesCloneTest-937572294 None] Created volume successfully. Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d660c-e06d-4e21-aacf-ce2d435810bd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:19 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 Jul 17 07:14:19 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:20 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09" returned: 0 in 0.574s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305b8410-025c-4043-aec4-f5602a75042e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[018142e6-4167-4d7a-b367-0654617617d4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:20 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:14:20 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.734s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:20 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:14:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:20 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 Jul 17 07:14:20 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Flow 'volume_create_manager' (6cc381de-18a8-45ca-82b4-ebdaa2a91424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422dc2f0-c433-46a6-998f-d29172507127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422dc2f0-c433-46a6-998f-d29172507127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1039854834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a6a4a8-27a4-4670-80a7-b22313110462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6c27163d304cbe826d084e26d54a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=05c379fa-714d-430e-9be6-9c358c0add70,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:21Z,use_quota=True,user_id='b5e9db7a387c494f82eaf4ade5815d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c24632-e434-4df8-9ce7-3404d6afc1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c24632-e434-4df8-9ce7-3404d6afc1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9762adfd-d0d9-47ec-be2d-b5d073fce8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9762adfd-d0d9-47ec-be2d-b5d073fce8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '80a6a4a8-27a4-4670-80a7-b22313110462', 'volume_name': 'volume-80a6a4a8-27a4-4670-80a7-b22313110462', 'volume_size': 2, 'source_volid': '05c379fa-714d-430e-9be6-9c358c0add70', 'source_volstatus': 'available'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00422dc2-0646-463a-aaad-c88928b1d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00422dc2-0646-463a-aaad-c88928b1d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb75f195-f00c-468f-a369-27ca7e64ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:21 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Volume 80a6a4a8-27a4-4670-80a7-b22313110462: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-80a6a4a8-27a4-4670-80a7-b22313110462', 'volume_size': 2, 'source_volid': '05c379fa-714d-430e-9be6-9c358c0add70', 'source_volstatus': 'available'} Jul 17 07:14:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:27 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776" returned: 0 in 6.968s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7f0f6-62a4-4161-bdc4-f3b7deffd7e1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:28 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:14:28 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:28 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.791s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:28 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:14:28 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Converted 1024.00 MB image at 146.93 MB/s Jul 17 07:14:28 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 is being set with open permissions: ugo+rw Jul 17 07:14:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:28 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 Jul 17 07:14:28 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:29 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776" returned: 0 in 0.377s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-6cedc07e-5577-4e5d-ba40-4c6e1687c776" released by "_copy_volume_from_snapshot" :: held 9.639s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-5fe8b119-457e-4261-8530-51abf183cb09-6cedc07e-5577-4e5d-ba40-4c6e1687c776" released by "_create_volume_from_snapshot" :: held 9.721s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.773s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.814s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:29 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Cloning volume 05c379fa-714d-430e-9be6-9c358c0add70 to volume 80a6a4a8-27a4-4670-80a7-b22313110462 Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4937d2-a485-4412-b2e6-2b1a5384dd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776', 'volume_size': 1, 'snapshot_id': '5fe8b119-457e-4261-8530-51abf183cb09'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b27f4-9f51-48f4-a0be-dc83946140ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Creating offline snapshot 9516b635-8477-4036-8a5e-acd1d9501fca of volume 05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:14:29 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Volume volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 (6cedc07e-5577-4e5d-ba40-4c6e1687c776): created successfully Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b27f4-9f51-48f4-a0be-dc83946140ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Flow 'volume_create_manager' (a6de82f9-0791-41a1-b2b2-c4684df029d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f7e94-321e-4476-8bfd-99f56191fdd1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9de37703-9a53-4aa6-9900-e1bfff475f08 tempest-TestStampPattern-157287600 None] Created volume successfully. Jul 17 07:14:29 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:29 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:29 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 0.457s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:29 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca 1G Jul 17 07:14:29 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:29 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:14:29 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:30 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca 1G" returned: 0 in 0.665s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c379fa-714d-430e-9be6-9c358c0add70 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:30 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c379fa-714d-430e-9be6-9c358c0add70 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca Jul 17 07:14:30 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:30 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.570s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:14:30 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c379fa-714d-430e-9be6-9c358c0add70 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:30 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca is being set with open permissions: ugo+rw Jul 17 07:14:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:30 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca Jul 17 07:14:30 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:31 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca" returned: 0 in 0.301s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:31 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info Jul 17 07:14:31 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:31 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info" returned: 0 in 0.386s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:31 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info is being set with open permissions: ugo+rw Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:31 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info Jul 17 07:14:31 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:31 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.info" returned: 0 in 0.267s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Acquiring lock "cinder-quobyte-80a6a4a8-27a4-4670-80a7-b22313110462" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-80a6a4a8-27a4-4670-80a7-b22313110462" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] snapshot: 9516b635-8477-4036-8a5e-acd1d9501fca, volume: 80a6a4a8-27a4-4670-80a7-b22313110462, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c6381-0b1b-4774-a11e-16e3aa87c9ad]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:32 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca Jul 17 07:14:32 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:32 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca" returned: 0 in 0.438s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c379fa-714d-430e-9be6-9c358c0add70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4385bc-9040-47cc-9027-5d357e961e7d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:32 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:32 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:32 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:14:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:32 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 Jul 17 07:14:32 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:41 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=41,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:14:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-b838601f-1ecf-4165-873d-85215836e31f req-63b24062-4973-433f-92b7-c5250804b08c tempest-TestShelveInstance-1009785415 None] Terminate volume connection completed successfully. Jul 17 07:14:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-b838601f-1ecf-4165-873d-85215836e31f req-63b24062-4973-433f-92b7-c5250804b08c tempest-TestShelveInstance-1009785415 None] Deleting attachment fc00735d-928f-4603-aa20-236f82918537. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:14:42 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462" returned: 0 in 10.068s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:42 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1baf6c-c787-403a-8601-655ae67e7826]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Acquiring lock "cinder-ddb25901-79b5-42b1-867d-3cc259952c38-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Lock "cinder-ddb25901-79b5-42b1-867d-3cc259952c38-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Acquiring lock "cinder-quobyte-ddb25901-79b5-42b1-867d-3cc259952c38" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:43 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:43 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:43 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Lock "cinder-quobyte-ddb25901-79b5-42b1-867d-3cc259952c38" acquired by "delete_volume" :: waited 0.054s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:43 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc2e821-df15-4534-986a-e10a590bdcb4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:43 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 Jul 17 07:14:43 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:44 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 1.198s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70, size 1024.00 MB, duration 10.07 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:14:44 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Converted 1024.00 MB image at 101.70 MB/s Jul 17 07:14:44 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 is being set with open permissions: ugo+rw Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:44 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 Jul 17 07:14:44 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:44 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38" returned: 0 in 0.934s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:44 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38 Jul 17 07:14:44 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:44 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462" returned: 0 in 0.312s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-80a6a4a8-27a4-4670-80a7-b22313110462" released by "_copy_volume_from_snapshot" :: held 12.605s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Acquiring lock "cinder-quobyte-9516b635-8477-4036-8a5e-acd1d9501fca" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-9516b635-8477-4036-8a5e-acd1d9501fca" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Deleting offline snapshot 9516b635-8477-4036-8a5e-acd1d9501fca of volume 05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] snapshot_file for this snap is: volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f79180a-92ee-49eb-b9d5-986bfd9a0d99]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:44 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ddb25901-79b5-42b1-867d-3cc259952c38" returned: 0 in 0.317s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Lock "cinder-quobyte-ddb25901-79b5-42b1-867d-3cc259952c38" released by "delete_volume" :: held 1.331s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.quota [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Created reservations ['3edb48bc-1f1b-49e4-a2e6-00ebeb713d78', 'b41d9305-924b-4464-a027-99102cbdd884', '77092983-44b9-4708-8d57-28dfb0cb7812', 'cacca776-3e5a-46df-9cea-971e1c4510d0'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:14:44 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca Jul 17 07:14:44 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:44 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:14:44 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:44 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca" returned: 0 in 0.363s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c379fa-714d-430e-9be6-9c358c0add70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf80f9e-707d-491d-8e47-fe5334465b89]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:44 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:44 devstack cinder-volume[87331]: DEBUG cinder.manager [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:14:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Deleted volume successfully. Jul 17 07:14:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [req-b838601f-1ecf-4165-873d-85215836e31f req-eccb05fe-3fb5-491b-a03f-355355f701bd tempest-TestShelveInstance-1009785415 None] Lock "cinder-ddb25901-79b5-42b1-867d-3cc259952c38-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:45 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:45 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:45 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 0.402s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:45 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca Jul 17 07:14:45 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:45 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca" returned: 0 in 0.382s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:45 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca Jul 17 07:14:45 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:46 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70.9516b635-8477-4036-8a5e-acd1d9501fca" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-9516b635-8477-4036-8a5e-acd1d9501fca" released by "_delete_snapshot" :: held 1.531s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.965s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb75f195-f00c-468f-a369-27ca7e64ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a6a4a8-27a4-4670-80a7-b22313110462', 'volume_size': 2, 'source_volid': '05c379fa-714d-430e-9be6-9c358c0add70', 'source_volstatus': 'available'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090ef11f-526b-4643-ab8e-ce972dfc8b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:46 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Volume volume-80a6a4a8-27a4-4670-80a7-b22313110462 (80a6a4a8-27a4-4670-80a7-b22313110462): created successfully Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090ef11f-526b-4643-ab8e-ce972dfc8b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Flow 'volume_create_manager' (6cc381de-18a8-45ca-82b4-ebdaa2a91424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:46 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4063bacc-887b-4bf6-8c56-4684ee4a7d45 tempest-VolumesCloneTest-937572294 None] Created volume successfully. Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Acquiring lock "cinder-80a6a4a8-27a4-4670-80a7-b22313110462-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Lock "cinder-80a6a4a8-27a4-4670-80a7-b22313110462-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Acquiring lock "cinder-quobyte-80a6a4a8-27a4-4670-80a7-b22313110462" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-80a6a4a8-27a4-4670-80a7-b22313110462" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e65a578-ebab-4dc9-bd63-4db2b18a113d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:46 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 Jul 17 07:14:46 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:47 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462" returned: 0 in 0.398s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:47 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462 Jul 17 07:14:47 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:47 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-80a6a4a8-27a4-4670-80a7-b22313110462" returned: 0 in 0.354s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-80a6a4a8-27a4-4670-80a7-b22313110462" released by "delete_volume" :: held 0.803s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Created reservations ['030687c7-0e4f-4ebc-b2fd-b205a4ff9228', '04a579c2-17aa-4ca0-b582-95cc5c3b4b70', 'b75c8b49-6717-46eb-b92c-b0f5c7b0640e', 'cbdef8b3-1bc9-4b63-b6c9-2cfa5c93185a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:47 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:14:47 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Acquiring lock "cinder-05c379fa-714d-430e-9be6-9c358c0add70-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Lock "cinder-05c379fa-714d-430e-9be6-9c358c0add70-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Acquiring lock "cinder-quobyte-05c379fa-714d-430e-9be6-9c358c0add70" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-05c379fa-714d-430e-9be6-9c358c0add70" acquired by "delete_volume" :: waited 0.040s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2b9cc-d284-4ec4-8f86-e3f23869ce7c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:48 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.467s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:14:48 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Deleted volume successfully. Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8489b5c6-5b89-47b2-81d4-2363862def9e tempest-VolumesCloneTest-937572294 None] Lock "cinder-80a6a4a8-27a4-4670-80a7-b22313110462-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:48 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:48 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:48 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 0.451s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:48 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70 Jul 17 07:14:48 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:48 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-05c379fa-714d-430e-9be6-9c358c0add70" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Lock "cinder-quobyte-05c379fa-714d-430e-9be6-9c358c0add70" released by "delete_volume" :: held 0.793s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Created reservations ['407ce300-4df5-47d3-9d7f-6399838495a9', '42808a88-6ba3-4629-b9c3-5929b6a6badc', 'b1b117f6-99d1-4460-88fd-99041165c548', 'a1767d65-4a88-4178-b4a6-94bf58deaded'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:49 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:14:49 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:49 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.278s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:14:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Deleted volume successfully. Jul 17 07:14:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-782431b5-0261-4fdd-9f77-5ab0884c1eff tempest-VolumesCloneTest-937572294 None] Lock "cinder-05c379fa-714d-430e-9be6-9c358c0add70-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=49,cinder:UPDATE=48,cinder:INSERT=9,cinder:DELETE=7 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (03cf6be1-2057-459f-a0b2-8e99a054edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53ad16b-8c54-4019-9972-bf4e040b911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53ad16b-8c54-4019-9972-bf4e040b911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-714973051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:58Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77172e5-e56a-4652-a8de-9bd6f87f9cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77172e5-e56a-4652-a8de-9bd6f87f9cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1590e4a-22ff-41bc-bb2e-3d0bffd228ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1590e4a-22ff-41bc-bb2e-3d0bffd228ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528', 'volume_name': 'volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73634444-8490-45c7-96e6-8098659905c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73634444-8490-45c7-96e6-8098659905c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8638c89e-58af-4046-9b70-c495b9c185df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:57 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528', 'volume_size': 1} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-714973051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:14:58Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating volume da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:14:57 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:14:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:57 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 1073741824 Jul 17 07:14:57 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:58 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 1073741824" returned: 0 in 0.838s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:14:58 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 Jul 17 07:14:58 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:14:58 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8638c89e-58af-4046-9b70-c495b9c185df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7fc8d5-87db-450c-920a-3656c5fbf587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:14:58 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 (da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528): created successfully Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7fc8d5-87db-450c-920a-3656c5fbf587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:14:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (03cf6be1-2057-459f-a0b2-8e99a054edd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:14:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8e7b5ba9-ec55-492c-b467-800dc71b3bab tempest-CreateVolumesFromSnapshotTest-855439488 None] Created volume successfully. Jul 17 07:14:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:14:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:14:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating offline snapshot 360e8add-e6a0-40ef-aa34-23f5baf3dc1d of volume da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:14:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685040a-5f23-4f4a-891e-86a6c4e6b200]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:00 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 Jul 17 07:15:00 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:00 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" returned: 0 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:00 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d 1G Jul 17 07:15:00 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:00 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d 1G" returned: 0 in 0.452s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:00 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d Jul 17 07:15:00 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:01 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d" returned: 0 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:01 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d is being set with open permissions: ugo+rw Jul 17 07:15:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:01 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d Jul 17 07:15:01 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:01 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d" returned: 0 in 0.258s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:01 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info Jul 17 07:15:01 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:01 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:01 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info is being set with open permissions: ugo+rw Jul 17 07:15:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:01 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info Jul 17 07:15:01 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:02 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.info" returned: 0 in 0.267s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:02 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a8c63c26-7c93-4a8c-8340-8c71d1064693 tempest-CreateVolumesFromSnapshotTest-855439488 None] Create snapshot completed successfully Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (ad5036ab-0a1c-4e37-9edb-2501ef1a97ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ee8532-311d-4054-b15c-a2e9d176411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ee8532-311d-4054-b15c-a2e9d176411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014563591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67445f8-7bd4-47f9-ade7-9b52da990f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:04Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70a601c-02a1-497a-a78d-0d2b4179951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70a601c-02a1-497a-a78d-0d2b4179951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5db333-645a-4210-8c6d-7483f838910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5db333-645a-4210-8c6d-7483f838910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67445f8-7bd4-47f9-ade7-9b52da990f7b', 'volume_name': 'volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde6bc85-be0c-4f1c-ba93-54cd222c87a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde6bc85-be0c-4f1c-ba93-54cd222c87a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9b6797-d7c8-495c-b166-49d205fe7ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:03 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume c67445f8-7bd4-47f9-ade7-9b52da990f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b', 'volume_size': 1} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014563591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67445f8-7bd4-47f9-ade7-9b52da990f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:04Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating volume c67445f8-7bd4-47f9-ade7-9b52da990f7b {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:03 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:03 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b 1073741824 Jul 17 07:15:03 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (f6b7fd95-5d20-40ec-baa7-6e7489bc42e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf322f3-37ed-4884-9d5a-b6652f3d73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf322f3-37ed-4884-9d5a-b6652f3d73b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878568026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1f06c2-52f9-42a9-a0c8-d9afa575ec84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:04Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f047846-eab9-4107-81cf-92ce75d5ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f047846-eab9-4107-81cf-92ce75d5ef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030fc66e-ec03-45db-a803-1227e7eb35d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030fc66e-ec03-45db-a803-1227e7eb35d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1f06c2-52f9-42a9-a0c8-d9afa575ec84', 'volume_name': 'volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13857e69-41db-4853-baf3-73656a159ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13857e69-41db-4853-baf3-73656a159ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4ad944-7871-48d3-88df-5c6d4988c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:04 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume ce1f06c2-52f9-42a9-a0c8-d9afa575ec84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84', 'volume_size': 1} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:04 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b 1073741824" returned: 0 in 0.860s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:04 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b Jul 17 07:15:04 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (15c875ff-5a0f-4c3a-bff9-e5dc7345804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218c76a5-4279-481c-8277-d21bcdaa0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218c76a5-4279-481c-8277-d21bcdaa0d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2053534544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0a3363-16c5-421c-be49-566e7ccb8962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:05Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a283f09-23de-41af-8e75-1f45113662e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a283f09-23de-41af-8e75-1f45113662e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d91b2-f274-4d39-bce6-923bb5ef4862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d91b2-f274-4d39-bce6-923bb5ef4862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0a3363-16c5-421c-be49-566e7ccb8962', 'volume_name': 'volume-7d0a3363-16c5-421c-be49-566e7ccb8962', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55777d35-e4c7-47eb-8f60-ba2628b66424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55777d35-e4c7-47eb-8f60-ba2628b66424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700e79d7-c3f5-49b5-aea1-48ee2d1e63e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume 7d0a3363-16c5-421c-be49-566e7ccb8962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0a3363-16c5-421c-be49-566e7ccb8962', 'volume_size': 1} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:05 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b" returned: 0 in 0.611s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878568026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1f06c2-52f9-42a9-a0c8-d9afa575ec84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:04Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating volume ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:05 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:05 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 1073741824 Jul 17 07:15:05 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9b6797-d7c8-495c-b166-49d205fe7ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8ab6c3-34cf-423f-a2f0-77e35d8e3a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b (c67445f8-7bd4-47f9-ade7-9b52da990f7b): created successfully Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8ab6c3-34cf-423f-a2f0-77e35d8e3a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (ad5036ab-0a1c-4e37-9edb-2501ef1a97ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (8b3f37d8-b0e3-470a-ace0-70007bf5aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff13a58-2475-4e04-b417-41d639fa4dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cb4977e8-2a37-4e2e-adcf-d05a3d24f36c tempest-CreateVolumesFromSnapshotTest-855439488 None] Created volume successfully. Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff13a58-2475-4e04-b417-41d639fa4dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757907453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fae7c7-16ac-403a-b447-72503382bcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:05Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211ce0c2-2269-4dad-9a94-38634dd76fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211ce0c2-2269-4dad-9a94-38634dd76fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986c6ffb-a738-4cb5-addc-b7d6c5b0aa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986c6ffb-a738-4cb5-addc-b7d6c5b0aa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fae7c7-16ac-403a-b447-72503382bcc8', 'volume_name': 'volume-59fae7c7-16ac-403a-b447-72503382bcc8', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d3cd8c-f5fd-4190-96e7-22ce37067899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d3cd8c-f5fd-4190-96e7-22ce37067899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505eb94c-1a2e-4cfe-94ea-4486519cdf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume 59fae7c7-16ac-403a-b447-72503382bcc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fae7c7-16ac-403a-b447-72503382bcc8', 'volume_size': 1} Jul 17 07:15:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (0aa799c9-6af2-4ba1-88df-a3211cb7522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06a6546-6760-49aa-b2e2-a8b8084b07e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06a6546-6760-49aa-b2e2-a8b8084b07e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368104765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e04c40-d83a-4a0f-b42e-539419a26e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:06Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dcbe3e-4181-48bf-b7f9-6c0ed05e6808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:06 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dcbe3e-4181-48bf-b7f9-6c0ed05e6808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ad1250-9861-485a-a6fa-53bd82500604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ad1250-9861-485a-a6fa-53bd82500604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e04c40-d83a-4a0f-b42e-539419a26e69', 'volume_name': 'volume-11e04c40-d83a-4a0f-b42e-539419a26e69', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b30fb7f-3515-4d78-96ec-81009c7b5a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b30fb7f-3515-4d78-96ec-81009c7b5a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d848765-e73c-4e5d-b201-24fdece2d766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:06 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume 11e04c40-d83a-4a0f-b42e-539419a26e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e04c40-d83a-4a0f-b42e-539419a26e69', 'volume_size': 1} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 1073741824" returned: 0 in 1.054s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:06 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 Jul 17 07:15:06 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-fc44749d-5e64-406a-8ea9-26150b511b8a req-429caeb8-68b4-4b54-9c02-118080c0501d tempest-TestMinimumBasicScenario-1859170804 None] Terminate volume connection completed successfully. Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-fc44749d-5e64-406a-8ea9-26150b511b8a req-429caeb8-68b4-4b54-9c02-118080c0501d tempest-TestMinimumBasicScenario-1859170804 None] Deleting attachment 44af0fbc-5866-4af3-bae5-6d36eea6ce3b. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:15:06 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.655s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2053534544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0a3363-16c5-421c-be49-566e7ccb8962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:05Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating volume 7d0a3363-16c5-421c-be49-566e7ccb8962 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:06 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4ad944-7871-48d3-88df-5c6d4988c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:06 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 1073741824 Jul 17 07:15:06 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48175b4d-91cb-445a-a4fb-da992b0544e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:06 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 (ce1f06c2-52f9-42a9-a0c8-d9afa575ec84): created successfully Jul 17 07:15:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48175b4d-91cb-445a-a4fb-da992b0544e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (f6b7fd95-5d20-40ec-baa7-6e7489bc42e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7901f237-9b1f-4020-a4c8-9566fbc0862f tempest-CreateVolumesFromSnapshotTest-855439488 None] Created volume successfully. Jul 17 07:15:07 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 1073741824" returned: 0 in 0.593s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:07 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 Jul 17 07:15:07 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Acquiring lock "cinder-66f5f488-b9d0-4edd-b5c5-aa1e23071804-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Lock "cinder-66f5f488-b9d0-4edd-b5c5-aa1e23071804-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Acquiring lock "cinder-quobyte-66f5f488-b9d0-4edd-b5c5-aa1e23071804" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Lock "cinder-quobyte-66f5f488-b9d0-4edd-b5c5-aa1e23071804" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:07 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962" returned: 0 in 0.325s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757907453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fae7c7-16ac-403a-b447-72503382bcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:05Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating volume 59fae7c7-16ac-403a-b447-72503382bcc8 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:07 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1cb7d-0fb8-4aad-a445-5599fe65ed58]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:07 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 1073741824 Jul 17 07:15:07 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700e79d7-c3f5-49b5-aea1-48ee2d1e63e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0a3363-16c5-421c-be49-566e7ccb8962', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaa6c42-3afa-4ef2-a470-694cc182cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume volume-7d0a3363-16c5-421c-be49-566e7ccb8962 (7d0a3363-16c5-421c-be49-566e7ccb8962): created successfully Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaa6c42-3afa-4ef2-a470-694cc182cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (15c875ff-5a0f-4c3a-bff9-e5dc7345804e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c1d560c9-0f5d-4c95-90ec-8318b4726b55 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created volume successfully. Jul 17 07:15:08 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 Jul 17 07:15:08 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:08 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804" returned: 0 in 0.407s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:08 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804 Jul 17 07:15:08 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:08 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 1073741824" returned: 0 in 0.553s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:08 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 Jul 17 07:15:08 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:08 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-66f5f488-b9d0-4edd-b5c5-aa1e23071804" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Lock "cinder-quobyte-66f5f488-b9d0-4edd-b5c5-aa1e23071804" released by "delete_volume" :: held 0.816s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Created reservations ['1a038234-1c3f-49db-9cfd-69e96572c481', '7d3ff738-286c-4391-b1f6-a60b7be7ba62', '409b9066-08ce-4475-b94e-18f6cfd136c4', '61b8ca5c-899a-4f5a-9b6d-d5710f638922'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:08 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8" returned: 0 in 0.267s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368104765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e04c40-d83a-4a0f-b42e-539419a26e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749c3f0a5de14d299a78a861178835e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:06Z,use_quota=True,user_id='008fec077cc24c3896ef122c2d11c0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Creating volume 11e04c40-d83a-4a0f-b42e-539419a26e69 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:08 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:08 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 1073741824 Jul 17 07:15:08 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505eb94c-1a2e-4cfe-94ea-4486519cdf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fae7c7-16ac-403a-b447-72503382bcc8', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba86f1cc-e9b9-4690-9ed4-68470e634a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume volume-59fae7c7-16ac-403a-b447-72503382bcc8 (59fae7c7-16ac-403a-b447-72503382bcc8): created successfully Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba86f1cc-e9b9-4690-9ed4-68470e634a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (8b3f37d8-b0e3-470a-ace0-70007bf5aa29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:08 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:08 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:08 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a6d3dd1f-680f-436a-b03e-6de88ff52717 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created volume successfully. Jul 17 07:15:09 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.401s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Deleted volume successfully. Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f2546ccb-20a4-4acb-8795-39edb3d6a9c2 tempest-TestMinimumBasicScenario-1859170804 None] Lock "cinder-66f5f488-b9d0-4edd-b5c5-aa1e23071804-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:09 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 1073741824" returned: 0 in 0.623s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:09 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 Jul 17 07:15:09 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:09 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69" returned: 0 in 0.476s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d848765-e73c-4e5d-b201-24fdece2d766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e04c40-d83a-4a0f-b42e-539419a26e69', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f2cd14-4d66-47d5-9a69-feb4c20417b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Volume volume-11e04c40-d83a-4a0f-b42e-539419a26e69 (11e04c40-d83a-4a0f-b42e-539419a26e69): created successfully Jul 17 07:15:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f2cd14-4d66-47d5-9a69-feb4c20417b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Flow 'volume_create_manager' (0aa799c9-6af2-4ba1-88df-a3211cb7522f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7248deb5-5a65-4ed1-9c5f-372ca0450215 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created volume successfully. Jul 17 07:15:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-11e04c40-d83a-4a0f-b42e-539419a26e69-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-11e04c40-d83a-4a0f-b42e-539419a26e69-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-11e04c40-d83a-4a0f-b42e-539419a26e69" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-11e04c40-d83a-4a0f-b42e-539419a26e69" acquired by "delete_volume" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae0be92-7e21-4635-8fbf-7d9d45392a89]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:11 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 Jul 17 07:15:11 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:11 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69" returned: 0 in 0.360s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:11 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69 Jul 17 07:15:11 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:11 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-11e04c40-d83a-4a0f-b42e-539419a26e69" returned: 0 in 0.252s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-11e04c40-d83a-4a0f-b42e-539419a26e69" released by "delete_volume" :: held 0.659s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['bda8dcf5-6757-443d-b5e4-5ceb91bf7c0a', 'd9d44458-4eea-4c8d-9ed0-0e1a9e3e68e1', '5f1a82b3-fc79-403f-a302-a18c1150a96e', '6130c938-a74d-4d09-a1e2-194e5acd474f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:11 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:11 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:12 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:12 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleted volume successfully. Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-59fae7c7-16ac-403a-b447-72503382bcc8-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-59fae7c7-16ac-403a-b447-72503382bcc8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181af5c8-06b5-4faf-a102-78eace11e1d2 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-11e04c40-d83a-4a0f-b42e-539419a26e69-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-59fae7c7-16ac-403a-b447-72503382bcc8" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-59fae7c7-16ac-403a-b447-72503382bcc8" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61f4cb-9efa-443b-9896-cd6695c7bcf7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:12 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 Jul 17 07:15:12 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:13 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8" returned: 0 in 0.628s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:13 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8 Jul 17 07:15:13 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76362f-a0f1-4503-adc3-73b203640415]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:13 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 Jul 17 07:15:13 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:13 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-59fae7c7-16ac-403a-b447-72503382bcc8" returned: 0 in 0.466s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-59fae7c7-16ac-403a-b447-72503382bcc8" released by "delete_volume" :: held 1.147s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['9046a489-e98f-4c51-8af9-99756eabb96d', '57e3868b-79ec-477a-8d5c-294d21bcaffd', 'af3dcd38-6618-48b0-922f-3830143a2bdf', '012dd039-8a22-489c-8eeb-cd28578368ef'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:13 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776" returned: 0 in 0.552s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.590s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47f1654c-d7c6-40b0-b24c-ba34596e2300', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:15:13 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:13 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-716d0308-f0a9-4420-96e6-53d026f54191 req-5a93906b-0c8c-42c3-9c53-fe4ac20e6fd7 tempest-TestStampPattern-157287600 None] attachment_update completed successfully. Jul 17 07:15:14 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleted volume successfully. Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cb1c54ec-6545-46ca-926c-06f646caecea tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-59fae7c7-16ac-403a-b447-72503382bcc8-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-7d0a3363-16c5-421c-be49-566e7ccb8962-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-7d0a3363-16c5-421c-be49-566e7ccb8962-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-7d0a3363-16c5-421c-be49-566e7ccb8962" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-7d0a3363-16c5-421c-be49-566e7ccb8962" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e53a2f5-3b89-4af5-90f0-c6f2c6f12a46]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:15 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 Jul 17 07:15:15 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:15 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962" returned: 0 in 0.544s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:15 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962 Jul 17 07:15:15 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:15 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d0a3363-16c5-421c-be49-566e7ccb8962" returned: 0 in 0.356s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-7d0a3363-16c5-421c-be49-566e7ccb8962" released by "delete_volume" :: held 0.972s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:15 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['daeef3c7-9480-4b9a-9322-be877c172d65', '0c324d43-710d-428a-acf0-eeb90fee72ef', '681396c9-2835-4680-b871-cb4fde2f3c88', '612481d9-34e7-48e2-8466-3f7e5ec517e8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:16 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:16 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:16 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.467s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleted volume successfully. Jul 17 07:15:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c28c2afd-289b-4f60-aae0-fb36afd20583 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-7d0a3363-16c5-421c-be49-566e7ccb8962-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-3719b793-4a67-41a2-b665-2fec22f213ed req-bfb9ba44-0f05-4cb2-af11-c9a903693c78 tempest-TestStampPattern-157287600 None] Terminate volume connection completed successfully. Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-3719b793-4a67-41a2-b665-2fec22f213ed req-bfb9ba44-0f05-4cb2-af11-c9a903693c78 tempest-TestStampPattern-157287600 None] Deleting attachment 47f1654c-d7c6-40b0-b24c-ba34596e2300. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d70191-7e8a-4506-8e8f-07c9ca3f0526]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:17 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 Jul 17 07:15:17 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:17 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84" returned: 0 in 0.445s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:17 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84 Jul 17 07:15:17 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:18 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84" returned: 0 in 0.355s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84" released by "delete_volume" :: held 0.873s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['fb582d21-3588-4b94-ac9d-a8fa8d4c71ef', 'b00b223f-a2a0-4c0f-8c36-41a7144b47fb', '64e826ff-38a5-4498-abc4-c3c271eb9f9b', '9c1c4465-ae51-4481-beec-f2dad24a4b77'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:18 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:18 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-c67445f8-7bd4-47f9-ade7-9b52da990f7b-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-c67445f8-7bd4-47f9-ade7-9b52da990f7b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-c67445f8-7bd4-47f9-ade7-9b52da990f7b" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-c67445f8-7bd4-47f9-ade7-9b52da990f7b" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0460a128-e810-4bc6-9011-b85d3b019b75]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:18 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleted volume successfully. Jul 17 07:15:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4576593e-eb6c-4b81-add5-4f110addf7bf tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-ce1f06c2-52f9-42a9-a0c8-d9afa575ec84-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:18 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b Jul 17 07:15:18 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:19 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b" returned: 0 in 0.463s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:19 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b Jul 17 07:15:19 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:19 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-c67445f8-7bd4-47f9-ade7-9b52da990f7b" returned: 0 in 0.442s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-c67445f8-7bd4-47f9-ade7-9b52da990f7b" released by "delete_volume" :: held 0.977s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['56fc7b2d-2412-4e07-83e5-22d8f7689f59', 'f4490583-b162-48ba-96e5-ceef4e518f3a', '4746f2df-94c6-4aea-862a-1dc6ea0f42d9', '853026dc-4035-4a4c-8e68-be8a75dce313'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:19 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:19 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:20 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.506s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleted volume successfully. Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4afe999d-a234-4171-a11e-143dc2ed76a5 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-c67445f8-7bd4-47f9-ade7-9b52da990f7b-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-360e8add-e6a0-40ef-aa34-23f5baf3dc1d-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-360e8add-e6a0-40ef-aa34-23f5baf3dc1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-360e8add-e6a0-40ef-aa34-23f5baf3dc1d" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-360e8add-e6a0-40ef-aa34-23f5baf3dc1d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleting offline snapshot 360e8add-e6a0-40ef-aa34-23f5baf3dc1d of volume da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] snapshot_file for this snap is: volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b50b08-6055-4331-97b1-60d551e5a506]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:21 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d Jul 17 07:15:21 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:21 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d" returned: 0 in 0.580s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:15:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3e51d-d4d5-43b4-bb5b-4c4baeb7dd4e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:21 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 Jul 17 07:15:21 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:22 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" returned: 0 in 0.568s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:22 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d Jul 17 07:15:22 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:22 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d" returned: 0 in 0.418s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:22 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d Jul 17 07:15:22 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:22 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528.360e8add-e6a0-40ef-aa34-23f5baf3dc1d" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-360e8add-e6a0-40ef-aa34-23f5baf3dc1d" released by "_delete_snapshot" :: held 2.007s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" released by "delete_snapshot" :: held 2.036s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-6cedc07e-5577-4e5d-ba40-4c6e1687c776-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Lock "cinder-6cedc07e-5577-4e5d-ba40-4c6e1687c776-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['a8973b72-fad8-43e2-88d4-fb6555e2df06', '9447f58c-c9cf-41c7-bfbe-8900636150e1', '495e9cd4-464b-4856-9ab7-f59c84737ce2', '00547554-b6ef-4c65-8c7d-79a59bfa37d5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-quobyte-6cedc07e-5577-4e5d-ba40-4c6e1687c776" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-6cedc07e-5577-4e5d-ba40-4c6e1687c776" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f481e-a455-4442-8cee-a3a1775a6d71]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Delete snapshot completed successfully. Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e6fe288b-03d1-43fe-9270-5f07a8934f47 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-360e8add-e6a0-40ef-aa34-23f5baf3dc1d-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:23 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 Jul 17 07:15:23 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:23 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776" returned: 0 in 0.392s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:23 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776 Jul 17 07:15:23 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:23 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cedc07e-5577-4e5d-ba40-4c6e1687c776" returned: 0 in 0.281s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-6cedc07e-5577-4e5d-ba40-4c6e1687c776" released by "delete_volume" :: held 0.718s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Created reservations ['3859e904-eee5-4d35-98d7-700c5b9358d4', '97fff754-a0e4-44ec-a2a1-8aa2c1ef39cf', '4ef63a92-0480-4759-b022-79870382b5f9', 'd990ebe7-e165-47fd-84ce-3002b5d25068'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:23 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:23 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "cinder-quobyte-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:24 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:24 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Deleted volume successfully. Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c03a97-a168-4ccf-9d48-0617d54e6fbd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-69f2ba49-a610-4d50-9ca9-d421efb7ca4d tempest-TestStampPattern-157287600 None] Lock "cinder-6cedc07e-5577-4e5d-ba40-4c6e1687c776-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:24 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 Jul 17 07:15:24 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-5fe8b119-457e-4261-8530-51abf183cb09-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Lock "cinder-5fe8b119-457e-4261-8530-51abf183cb09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-quobyte-305b8410-025c-4043-aec4-f5602a75042e" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-305b8410-025c-4043-aec4-f5602a75042e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-quobyte-5fe8b119-457e-4261-8530-51abf183cb09" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-5fe8b119-457e-4261-8530-51abf183cb09" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Deleting offline snapshot 5fe8b119-457e-4261-8530-51abf183cb09 of volume 305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] snapshot_file for this snap is: volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f76b39-f47c-4eba-850c-3fb049cc33f9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:24 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" returned: 0 in 0.520s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:24 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 Jul 17 07:15:24 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:24 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528 Jul 17 07:15:24 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:25 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09" returned: 0 in 0.474s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305b8410-025c-4043-aec4-f5602a75042e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:15:25 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" returned: 0 in 0.374s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349b405-0180-48b0-bc7f-37ac999cd028]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-quobyte-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528" released by "delete_volume" :: held 1.010s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Created reservations ['c1a8af05-237f-4d82-8654-e94f60a83062', 'ae060268-7179-4e97-a63b-e7b205032c14', 'dcb8e8ff-e8ee-4cdd-a33a-99c2d47475e6', '54cc7f4d-018e-4544-a68f-0f6b6ae0ac4b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:25 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:15:25 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:25 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:25 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:25 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.484s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:25 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 Jul 17 07:15:25 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:25 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.367s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Deleted volume successfully. Jul 17 07:15:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4a976f28-ccf3-4d1c-bf52-7524c509c598 tempest-CreateVolumesFromSnapshotTest-855439488 None] Lock "cinder-da6637fd-32bf-4ce3-a7d4-fe9ebfd4d528-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:26 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09" returned: 0 in 0.605s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:26 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09 Jul 17 07:15:26 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:26 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e.5fe8b119-457e-4261-8530-51abf183cb09" returned: 0 in 0.338s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-5fe8b119-457e-4261-8530-51abf183cb09" released by "_delete_snapshot" :: held 2.071s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-305b8410-025c-4043-aec4-f5602a75042e" released by "delete_snapshot" :: held 2.101s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Created reservations ['e997c029-9ae6-4579-a6eb-eabe57ec6cd2', 'e9790f93-dafe-4d93-8b2b-30e91cabf17c', 'f5849bd5-6f1e-477f-88eb-775a0f506474', '2881bcfc-3501-49dd-8f5e-8e60d342f20f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Delete snapshot completed successfully. Jul 17 07:15:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b747fb64-7b95-43d3-8bfc-fd9ca3f18149 tempest-TestStampPattern-157287600 None] Lock "cinder-5fe8b119-457e-4261-8530-51abf183cb09-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:29 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:29 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:30 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.375s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:15:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:15:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:15:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-305b8410-025c-4043-aec4-f5602a75042e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Lock "cinder-305b8410-025c-4043-aec4-f5602a75042e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Acquiring lock "cinder-quobyte-305b8410-025c-4043-aec4-f5602a75042e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-305b8410-025c-4043-aec4-f5602a75042e" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa5eda-7190-40ed-9707-90a37f50668a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Flow 'volume_create_manager' (ebf32afe-034e-4924-b336-18b3d8cd4d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b497acf2-b09c-4336-a8e4-e6eecbcea30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b497acf2-b09c-4336-a8e4-e6eecbcea30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1871586756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a46a6b-d0a5-4eaf-9896-f23d2f6fb118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f580ee068ee94f41848c001ea6c98bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:33Z,use_quota=True,user_id='f5531b1aa5f44a9eadfbf899a50e45f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e452133f-16d2-4599-9e8c-9221abb66403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e452133f-16d2-4599-9e8c-9221abb66403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d3ee5-0554-46e3-a7ab-2927197943ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130d3ee5-0554-46e3-a7ab-2927197943ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a46a6b-d0a5-4eaf-9896-f23d2f6fb118', 'volume_name': 'volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29df2f0-ca83-4b0b-aa19-b5977b548aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29df2f0-ca83-4b0b-aa19-b5977b548aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f04ff9d-d70d-409c-9e71-dd82adb9a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:33 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Volume 85a46a6b-d0a5-4eaf-9896-f23d2f6fb118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118', 'volume_size': 1} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1871586756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a46a6b-d0a5-4eaf-9896-f23d2f6fb118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f580ee068ee94f41848c001ea6c98bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:33Z,use_quota=True,user_id='f5531b1aa5f44a9eadfbf899a50e45f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Creating volume 85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:33 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:33 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:15:33 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:33 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 1073741824 Jul 17 07:15:33 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:34 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.885s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:34 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e Jul 17 07:15:34 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:34 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 1073741824" returned: 0 in 0.831s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:34 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:34 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:34 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-305b8410-025c-4043-aec4-f5602a75042e" returned: 0 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Lock "cinder-quobyte-305b8410-025c-4043-aec4-f5602a75042e" released by "delete_volume" :: held 1.387s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Created reservations ['96338315-a076-4232-b1ce-fc844b626163', '1dfbafb3-aa87-43a3-a7b5-b3d237c76be2', 'e4ec4e92-0e4f-4eff-bff9-e661faf3050c', 'e758c550-4960-4d5a-b57e-9cf55f808fdf'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (69d68320-88e5-47b6-a330-1981fd4e40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4799a-bf72-4328-a203-36d387b42ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:34 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.369s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4799a-bf72-4328-a203-36d387b42ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974190800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2c8524-fc83-4389-95dc-3ef2eddbe90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:35Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3026fa5-8974-45d6-828a-4114c9fd3fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3026fa5-8974-45d6-828a-4114c9fd3fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b39ca71-52b8-44c1-8e6d-fb23871f935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b39ca71-52b8-44c1-8e6d-fb23871f935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2c8524-fc83-4389-95dc-3ef2eddbe90a', 'volume_name': 'volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a48b076-38e5-4f31-b859-e26bdd5117ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a48b076-38e5-4f31-b859-e26bdd5117ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527d5151-9a5e-46d2-96c9-785a42a247af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume 1a2c8524-fc83-4389-95dc-3ef2eddbe90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a', 'volume_size': 1} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974190800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2c8524-fc83-4389-95dc-3ef2eddbe90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:35Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Creating volume 1a2c8524-fc83-4389-95dc-3ef2eddbe90a {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:34 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f04ff9d-d70d-409c-9e71-dd82adb9a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:34 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a 1073741824 Jul 17 07:15:34 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62330a60-f1b8-4e78-9467-15075c6b6974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Volume volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 (85a46a6b-d0a5-4eaf-9896-f23d2f6fb118): created successfully Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62330a60-f1b8-4e78-9467-15075c6b6974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Flow 'volume_create_manager' (ebf32afe-034e-4924-b336-18b3d8cd4d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3f780116-2451-403c-af76-687ade8e10f0 tempest-VolumeDependencyTests-1372587962 None] Created volume successfully. Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:34 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:34 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:35 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.414s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Deleted volume successfully. Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-91309556-ca3e-40bd-964b-6b022d178f86 tempest-TestStampPattern-157287600 None] Lock "cinder-305b8410-025c-4043-aec4-f5602a75042e-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:35 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a 1073741824" returned: 0 in 0.629s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:35 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a Jul 17 07:15:35 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:35 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a" returned: 0 in 0.444s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.161s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Creating offline snapshot 5cd5882d-8a93-4158-9413-2dbb0782873e of volume 85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527d5151-9a5e-46d2-96c9-785a42a247af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e221785-db30-4f62-82ba-9639a0fcc83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a7a12d-919b-4073-9db8-57b8ea4192c7]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:35 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a (1a2c8524-fc83-4389-95dc-3ef2eddbe90a): created successfully Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e221785-db30-4f62-82ba-9639a0fcc83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (69d68320-88e5-47b6-a330-1981fd4e40dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d6415320-f31b-4606-8321-a76be2327441 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created volume successfully. Jul 17 07:15:36 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:36 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:36 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.548s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:36 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e 1G Jul 17 07:15:36 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:37 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e 1G" returned: 0 in 0.617s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:37 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e Jul 17 07:15:37 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (eaf7890a-0201-4a4c-a718-a25877e58aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cf27b2-00f9-4c46-964c-2b5153f2fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cf27b2-00f9-4c46-964c-2b5153f2fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902122434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0725c4a-4e17-420e-991b-843cef35e001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:37Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12609aa9-fd7b-474f-951e-5b617061f73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12609aa9-fd7b-474f-951e-5b617061f73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bc4f83-de8b-4e36-82ac-928e8cd38dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bc4f83-de8b-4e36-82ac-928e8cd38dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0725c4a-4e17-420e-991b-843cef35e001', 'volume_name': 'volume-b0725c4a-4e17-420e-991b-843cef35e001', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76e62d9-c187-4e48-9723-8014db0a76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76e62d9-c187-4e48-9723-8014db0a76d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58eba366-f385-4c53-aaf2-b6e81929ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:37 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume b0725c4a-4e17-420e-991b-843cef35e001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0725c4a-4e17-420e-991b-843cef35e001', 'volume_size': 1} Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:37 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e" returned: 0 in 0.625s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:37 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e is being set with open permissions: ugo+rw Jul 17 07:15:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:37 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e Jul 17 07:15:37 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (ab8323ae-e27d-4a8f-92b3-0c824578a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9316069d-c211-42a6-b0c8-e45aecc6c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9316069d-c211-42a6-b0c8-e45aecc6c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-383457356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:38Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fcb154-21fe-4163-9d0b-0980acd7508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fcb154-21fe-4163-9d0b-0980acd7508f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1c5917-4d3a-4725-bd0d-da2ff8fb31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1c5917-4d3a-4725-bd0d-da2ff8fb31aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f', 'volume_name': 'volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6068290b-9c0d-42ec-bf64-e9690eba2dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6068290b-9c0d-42ec-bf64-e9690eba2dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3714ad73-9055-42fa-82e8-b0265dfab0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:38 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f', 'volume_size': 1} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:38 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e" returned: 0 in 0.583s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:38 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info Jul 17 07:15:38 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:38 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info" returned: 0 in 0.463s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:38 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info is being set with open permissions: ugo+rw Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:38 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info Jul 17 07:15:38 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (0ba7b27a-66e6-47ad-a10e-94824e38143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee8580f-e6a9-4dd3-9557-c1644fb80034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee8580f-e6a9-4dd3-9557-c1644fb80034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-499082832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfb09ec-6bcb-4eea-92b6-91f860f991c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:39Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e091a1e-2a2b-4fcd-977c-6b8e6ed496f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e091a1e-2a2b-4fcd-977c-6b8e6ed496f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c891eee1-d0bf-462c-b6d8-1b6355ebb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c891eee1-d0bf-462c-b6d8-1b6355ebb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acfb09ec-6bcb-4eea-92b6-91f860f991c0', 'volume_name': 'volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880b4df0-b9b2-4790-98ed-66e473f78138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880b4df0-b9b2-4790-98ed-66e473f78138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85be813f-7ef7-4123-b88b-946fbc1c510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume acfb09ec-6bcb-4eea-92b6-91f860f991c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0', 'volume_size': 1} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:39 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.info" returned: 0 in 0.650s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.620s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902122434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0725c4a-4e17-420e-991b-843cef35e001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:37Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Creating volume b0725c4a-4e17-420e-991b-843cef35e001 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:39 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4cf46db3-602d-4059-b80b-17b8b3d3fde1 tempest-VolumeDependencyTests-1372587962 None] Create snapshot completed successfully Jul 17 07:15:39 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 1073741824 Jul 17 07:15:39 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (8248fd7b-fb15-4b8d-9158-2976270a3150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89b85de-b95e-486a-8ade-100b47385ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89b85de-b95e-486a-8ade-100b47385ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1403416312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac22d1b-17e5-408c-881e-50988f874d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:40Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b58e11-9e14-4435-81e0-02899a844e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b58e11-9e14-4435-81e0-02899a844e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfe3696-1bf2-4e1b-8c3e-b98e95df76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfe3696-1bf2-4e1b-8c3e-b98e95df76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac22d1b-17e5-408c-881e-50988f874d34', 'volume_name': 'volume-8ac22d1b-17e5-408c-881e-50988f874d34', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c60888-e25c-420c-8607-ad8c75356098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c60888-e25c-420c-8607-ad8c75356098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e122596-7e6d-46b5-8759-825973e8f4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume 8ac22d1b-17e5-408c-881e-50988f874d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac22d1b-17e5-408c-881e-50988f874d34', 'volume_size': 1} Jul 17 07:15:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:40 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 1073741824" returned: 0 in 0.808s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (d8808d70-1a80-438f-881a-e9a3abaaa155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b422ce-bc43-429d-a248-408e308b97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b422ce-bc43-429d-a248-408e308b97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369108733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094559c-8cfd-41af-9f99-a20ec19c833f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:40Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a339e470-9a9c-43df-9544-de7bc8fe02d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a339e470-9a9c-43df-9544-de7bc8fe02d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7739052f-8048-42df-95e0-a2793d3be22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7739052f-8048-42df-95e0-a2793d3be22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9094559c-8cfd-41af-9f99-a20ec19c833f', 'volume_name': 'volume-9094559c-8cfd-41af-9f99-a20ec19c833f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcdf497-78aa-4aca-ad98-cf67aef043c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcdf497-78aa-4aca-ad98-cf67aef043c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cfaee7-88b7-4833-b703-19d371f0b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume 9094559c-8cfd-41af-9f99-a20ec19c833f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9094559c-8cfd-41af-9f99-a20ec19c833f', 'volume_size': 1} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:40 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 Jul 17 07:15:40 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:40 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001" returned: 0 in 0.398s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-383457356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:38Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Creating volume d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:40 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58eba366-f385-4c53-aaf2-b6e81929ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0725c4a-4e17-420e-991b-843cef35e001', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:40 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f 1073741824 Jul 17 07:15:40 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beeaa793-a6dc-47bf-a508-30ddd652c462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume volume-b0725c4a-4e17-420e-991b-843cef35e001 (b0725c4a-4e17-420e-991b-843cef35e001): created successfully Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beeaa793-a6dc-47bf-a508-30ddd652c462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (eaf7890a-0201-4a4c-a718-a25877e58aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c87f5f2d-f18f-47ca-b5bb-75cd572cf276 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created volume successfully. Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Flow 'volume_create_manager' (212951f1-8114-48c7-88a0-be4fb5a40d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c8f30a-1a58-4177-9b60-a9ec74d8f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c8f30a-1a58-4177-9b60-a9ec74d8f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583115806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f580ee068ee94f41848c001ea6c98bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5cd5882d-8a93-4158-9413-2dbb0782873e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:41Z,use_quota=True,user_id='f5531b1aa5f44a9eadfbf899a50e45f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bd8d83-b342-47ba-8e98-804aab368101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bd8d83-b342-47ba-8e98-804aab368101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c5cdbf-3e80-42fd-a73f-986cf3e020be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c5cdbf-3e80-42fd-a73f-986cf3e020be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6', 'volume_name': 'volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6', 'volume_size': 1, 'snapshot_id': '5cd5882d-8a93-4158-9413-2dbb0782873e'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f2973f-9161-41ca-bb1b-4e8acb6cee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f2973f-9161-41ca-bb1b-4e8acb6cee20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186947cf-092b-4e6b-b171-8aef7ec1a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Volume 544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6', 'volume_size': 1, 'snapshot_id': '5cd5882d-8a93-4158-9413-2dbb0782873e'} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=106,cinder:UPDATE=151,cinder:INSERT=29,cinder:DELETE=14 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:41 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f 1073741824" returned: 0 in 0.907s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:41 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f Jul 17 07:15:41 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:42 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.021s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-499082832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfb09ec-6bcb-4eea-92b6-91f860f991c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:39Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Creating volume acfb09ec-6bcb-4eea-92b6-91f860f991c0 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:42 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3714ad73-9055-42fa-82e8-b0265dfab0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:42 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 1073741824 Jul 17 07:15:42 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b116f4e7-6c81-4d16-a539-982770f0f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f (d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f): created successfully Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b116f4e7-6c81-4d16-a539-982770f0f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (ab8323ae-e27d-4a8f-92b3-0c824578a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4b439e66-970e-4ae4-a77c-8294237b25f1 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created volume successfully. Jul 17 07:15:42 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 1073741824" returned: 0 in 0.644s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:42 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 Jul 17 07:15:42 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:43 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0" returned: 0 in 0.329s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.509s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1403416312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac22d1b-17e5-408c-881e-50988f874d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:40Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Creating volume 8ac22d1b-17e5-408c-881e-50988f874d34 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85be813f-7ef7-4123-b88b-946fbc1c510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7ff185-53ba-428b-842b-f4781d17ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:43 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 1073741824 Jul 17 07:15:43 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 (acfb09ec-6bcb-4eea-92b6-91f860f991c0): created successfully Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7ff185-53ba-428b-842b-f4781d17ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (0ba7b27a-66e6-47ad-a10e-94824e38143c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f0e3c563-9918-470e-91e2-d438166c0c9b tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created volume successfully. Jul 17 07:15:43 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 1073741824" returned: 0 in 0.483s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:43 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 Jul 17 07:15:43 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:44 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.700s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369108733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094559c-8cfd-41af-9f99-a20ec19c833f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b2434a365ca495daf80cde097360225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:40Z,use_quota=True,user_id='19166c37ebc24b93b5f591027c5578fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Creating volume 9094559c-8cfd-41af-9f99-a20ec19c833f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e122596-7e6d-46b5-8759-825973e8f4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac22d1b-17e5-408c-881e-50988f874d34', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dbee3b-c8a7-4657-ba4f-6021ba674282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:44 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f 1073741824 Jul 17 07:15:44 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume volume-8ac22d1b-17e5-408c-881e-50988f874d34 (8ac22d1b-17e5-408c-881e-50988f874d34): created successfully Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dbee3b-c8a7-4657-ba4f-6021ba674282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (8248fd7b-fb15-4b8d-9158-2976270a3150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dfdd096d-83d9-4294-9aaf-dd4cf6aeb0dc tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created volume successfully. Jul 17 07:15:44 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f 1073741824" returned: 0 in 0.528s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:44 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f Jul 17 07:15:44 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:44 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f" returned: 0 in 0.280s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.392s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-quobyte-5cd5882d-8a93-4158-9413-2dbb0782873e-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cfaee7-88b7-4833-b703-19d371f0b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9094559c-8cfd-41af-9f99-a20ec19c833f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5c12ca-4e21-4581-83a3-6b4c9296239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-5cd5882d-8a93-4158-9413-2dbb0782873e-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" acquired by "_create_volume_from_snapshot" :: waited 0.074s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Creating volume 544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 from snapshot 5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-quobyte-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Volume volume-9094559c-8cfd-41af-9f99-a20ec19c833f (9094559c-8cfd-41af-9f99-a20ec19c833f): created successfully Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5c12ca-4e21-4581-83a3-6b4c9296239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Flow 'volume_create_manager' (d8808d70-1a80-438f-881a-e9a3abaaa155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] snapshot: 5cd5882d-8a93-4158-9413-2dbb0782873e, volume: 544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:15:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-03cc1b79-b9fb-4f9a-b6d2-749a0cf1608a tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created volume successfully. Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3986c24-b1af-4ab4-9bce-b1a76985c2cb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:45 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e Jul 17 07:15:45 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:45 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e" returned: 0 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[366df10c-49a2-4bb0-a7c1-93d79835a342]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:45 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:45 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:46 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.519s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:46 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 Jul 17 07:15:46 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-9094559c-8cfd-41af-9f99-a20ec19c833f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-9094559c-8cfd-41af-9f99-a20ec19c833f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-quobyte-9094559c-8cfd-41af-9f99-a20ec19c833f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-9094559c-8cfd-41af-9f99-a20ec19c833f" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e99e2b-46eb-4bce-a0fb-93dac1a1c077]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:46 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f Jul 17 07:15:46 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:46 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f" returned: 0 in 0.627s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:47 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f Jul 17 07:15:47 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:47 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9094559c-8cfd-41af-9f99-a20ec19c833f" returned: 0 in 0.487s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-9094559c-8cfd-41af-9f99-a20ec19c833f" released by "delete_volume" :: held 1.204s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created reservations ['34c69bb0-7487-4f7e-a016-a0fdb8b14d6a', '474410b7-f4f2-4f1b-bf6c-1d495c66cff5', '0778f12f-39ac-4385-93ea-c5a9195aabe4', 'ecf5b12a-d7e8-4d29-8d82-ccf705aae192'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:47 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:47 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-8ac22d1b-17e5-408c-881e-50988f874d34-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-8ac22d1b-17e5-408c-881e-50988f874d34-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:48 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.918s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-quobyte-8ac22d1b-17e5-408c-881e-50988f874d34" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:48 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Deleted volume successfully. Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-8ac22d1b-17e5-408c-881e-50988f874d34" acquired by "delete_volume" :: waited 0.041s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1868beb6-d183-449e-aee3-adf8d3ed2bd9 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-9094559c-8cfd-41af-9f99-a20ec19c833f-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[29025147-0925-4d92-86e2-f325babfa7d5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:49 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 Jul 17 07:15:49 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:49 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34" returned: 0 in 0.689s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:49 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34 Jul 17 07:15:49 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:50 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ac22d1b-17e5-408c-881e-50988f874d34" returned: 0 in 0.748s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-8ac22d1b-17e5-408c-881e-50988f874d34" released by "delete_volume" :: held 1.558s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created reservations ['5c80fac8-cfce-4aa8-ad5c-e87ea52747b3', 'd7ca768d-6776-4b4d-836c-da9e1b019040', '91eee9ae-71d5-4296-a11c-e32e1c1c5e63', '1c394815-0fe8-41f0-9c44-d4b33ca2dda1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:50 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:50 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-acfb09ec-6bcb-4eea-92b6-91f860f991c0-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-acfb09ec-6bcb-4eea-92b6-91f860f991c0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-quobyte-acfb09ec-6bcb-4eea-92b6-91f860f991c0" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-acfb09ec-6bcb-4eea-92b6-91f860f991c0" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9b629e-126e-41c4-a38c-2f013827ee20]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:51 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.752s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Deleted volume successfully. Jul 17 07:15:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d205bc36-8af8-4c37-8732-18bde6eb34c2 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-8ac22d1b-17e5-408c-881e-50988f874d34-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:51 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 Jul 17 07:15:51 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:52 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" returned: 0 in 5.948s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89836da-e09f-462b-bd8c-78950626169d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:52 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0" returned: 0 in 0.759s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:52 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0 Jul 17 07:15:52 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:52 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:52 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:52 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-acfb09ec-6bcb-4eea-92b6-91f860f991c0" returned: 0 in 0.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-acfb09ec-6bcb-4eea-92b6-91f860f991c0" released by "delete_volume" :: held 1.181s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created reservations ['01d7d1c2-08b4-486b-af90-5f985b5ddf94', '4efed2cd-f937-4d30-adce-5d69fdefc5ce', 'b65b5706-1d35-406a-a798-cc04164c5174', '0403e0f1-9143-44be-a743-ded863cfedcb'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:52 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:52 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:52 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.782s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:15:52 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Converted 1024.00 MB image at 172.08 MB/s Jul 17 07:15:52 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 is being set with open permissions: ugo+rw Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:52 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 Jul 17 07:15:52 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:52 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.357s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:52 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Deleted volume successfully. Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-38a78be8-bae6-4dfe-9209-947eac880d07 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-acfb09ec-6bcb-4eea-92b6-91f860f991c0-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:53 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" returned: 0 in 0.316s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" released by "_copy_volume_from_snapshot" :: held 8.109s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-5cd5882d-8a93-4158-9413-2dbb0782873e-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" released by "_create_volume_from_snapshot" :: held 8.175s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.251s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186947cf-092b-4e6b-b171-8aef7ec1a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6', 'volume_size': 1, 'snapshot_id': '5cd5882d-8a93-4158-9413-2dbb0782873e'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569a4bd4-a8d9-4a4b-ba6f-d6abe5ea0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:53 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Volume volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 (544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6): created successfully Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569a4bd4-a8d9-4a4b-ba6f-d6abe5ea0962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Flow 'volume_create_manager' (212951f1-8114-48c7-88a0-be4fb5a40d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-34427073-bc95-40e1-8990-4f529b20ff48 tempest-VolumeDependencyTests-1372587962 None] Created volume successfully. Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-quobyte-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4747b-0e24-4bea-9432-b16600a10e8c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:53 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f Jul 17 07:15:53 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:53 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f" returned: 0 in 0.398s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:54 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f Jul 17 07:15:54 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:54 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f" returned: 0 in 0.311s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f" released by "delete_volume" :: held 0.765s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-5cd5882d-8a93-4158-9413-2dbb0782873e-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-5cd5882d-8a93-4158-9413-2dbb0782873e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-quobyte-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-quobyte-5cd5882d-8a93-4158-9413-2dbb0782873e" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-5cd5882d-8a93-4158-9413-2dbb0782873e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Deleting offline snapshot 5cd5882d-8a93-4158-9413-2dbb0782873e of volume 85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] snapshot_file for this snap is: volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279f69e-b4af-4804-b206-f21f16e4c116]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created reservations ['8ceeb6d9-66f3-4899-bd74-d21f5ffc5f6a', 'aa844c11-dcd7-40e2-aaa2-29e27dc3b603', '81c6d4d3-4050-4253-a165-4db55d0cd701', '5057de8c-b6e2-4350-9b59-3f4e9cd00d8c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:54 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e Jul 17 07:15:54 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:54 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:54 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-b0725c4a-4e17-420e-991b-843cef35e001-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-b0725c4a-4e17-420e-991b-843cef35e001-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-quobyte-b0725c4a-4e17-420e-991b-843cef35e001" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-b0725c4a-4e17-420e-991b-843cef35e001" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e351d7-ef7b-47e6-99cf-b03437a7e02a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:54 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e" returned: 0 in 0.444s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:15:54 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Deleted volume successfully. Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2724ab-4b33-47ba-aa03-bb7b8652a36d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-421f68d0-6e8c-4b4b-96c9-147beabd8f18 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-d8684ba3-41e5-4c64-b7d8-c6fc7d08cd0f-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:54 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 Jul 17 07:15:55 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:55 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:55 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:55 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001" returned: 0 in 0.410s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:55 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001 Jul 17 07:15:55 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:55 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:55 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e Jul 17 07:15:55 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:55 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b0725c4a-4e17-420e-991b-843cef35e001" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-b0725c4a-4e17-420e-991b-843cef35e001" released by "delete_volume" :: held 0.722s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created reservations ['a0693322-ba46-4345-9af6-93f45973c440', '8c39113a-f22a-477a-befd-c45ad257ba07', '79d934e6-b084-4391-aa76-3a331006fbca', 'efe27cff-1e78-4ba7-b8f9-62e96eff8c7d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:55 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:55 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:55 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:55 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e Jul 17 07:15:55 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-1a2c8524-fc83-4389-95dc-3ef2eddbe90a-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-1a2c8524-fc83-4389-95dc-3ef2eddbe90a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:55 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "cinder-quobyte-1a2c8524-fc83-4389-95dc-3ef2eddbe90a" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Deleted volume successfully. Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-1a2c8524-fc83-4389-95dc-3ef2eddbe90a" acquired by "delete_volume" :: waited 0.037s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-34a2fdef-32e2-439e-9421-42f03606cfae tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-b0725c4a-4e17-420e-991b-843cef35e001-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:56 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2b1ff-24bc-4494-b5f1-eae9ccd58538]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118.5cd5882d-8a93-4158-9413-2dbb0782873e" returned: 0 in 0.317s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-5cd5882d-8a93-4158-9413-2dbb0782873e" released by "_delete_snapshot" :: held 1.695s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" released by "delete_snapshot" :: held 1.739s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:56 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a Jul 17 07:15:56 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Created reservations ['2054c186-3df4-4c8b-a7da-fc1861d4486c', '1322fa6c-07b7-4d41-8679-0e27de585d69', 'f99dbc81-7668-4964-8be9-7dc0077ad359', 'ae557b9f-81ec-4312-a7d2-f904db2fd0f8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Delete snapshot completed successfully. Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e18e7ea4-ab0b-4dea-bbae-0b9b27c018d6 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-5cd5882d-8a93-4158-9413-2dbb0782873e-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:56 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:56 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a Jul 17 07:15:56 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-quobyte-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fdaf5-1a29-40c5-a440-68dfb7f851a8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:56 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-1a2c8524-fc83-4389-95dc-3ef2eddbe90a" returned: 0 in 0.310s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-quobyte-1a2c8524-fc83-4389-95dc-3ef2eddbe90a" released by "delete_volume" :: held 0.759s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:56 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:56 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Created reservations ['cbe02fa0-e067-4990-a054-77657351a5a3', '6be167cf-f968-4d9d-a86b-3a2f6d1f384a', 'd11ac83d-09a8-4977-a20a-fc1485016f5a', 'b24a6176-1336-4bb3-acb0-b6f00b26a920'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:56 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:56 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:57 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.403s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:57 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118 Jul 17 07:15:57 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:57 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.300s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Deleted volume successfully. Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-572d2007-729d-4158-91a3-b8fea508c130 tempest-CreateVolumesFromSourceVolumeTest-1506557170 None] Lock "cinder-1a2c8524-fc83-4389-95dc-3ef2eddbe90a-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:57 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" returned: 0 in 0.297s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118" released by "delete_volume" :: held 0.775s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Created reservations ['1ff0fb34-94e3-4e91-8a33-bf8ebfe06835', 'f690e04f-0723-4fce-a1bd-31d25048a570', '99fff9df-bdd8-4aaa-8929-295da652ed1c', '599969f7-7a84-4234-8989-eee2a5d5631b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:57 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:57 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=146,cinder:UPDATE=186,cinder:INSERT=53,cinder:DELETE=13 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "cinder-quobyte-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7114ffd-3289-49a0-bab5-3274734caefb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:57 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.379s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Deleted volume successfully. Jul 17 07:15:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-254e2934-5d84-47b1-93e2-274c66beb1e8 tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-85a46a6b-d0a5-4eaf-9896-f23d2f6fb118-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:58 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 Jul 17 07:15:58 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:58 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" returned: 0 in 0.439s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:58 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6 Jul 17 07:15:58 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:58 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Flow 'volume_create_manager' (58331b11-3a19-4d80-9779-aad6e305be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42074373-3267-46e0-add6-294ea0dc59d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" returned: 0 in 0.382s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42074373-3267-46e0-add6-294ea0dc59d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ba126c-23e4-4393-a85f-09094db80329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55895adeb3e7427086abd6105bfce656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:59Z,use_quota=True,user_id='bee7eb8c255c40529b7f2f3f4984b3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5339f480-94dc-410b-b02f-1ef774429fed),volume_type_id=5339f480-94dc-410b-b02f-1ef774429fed)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8370afe9-bb2c-4a9f-ae0e-54e349d2c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8370afe9-bb2c-4a9f-ae0e-54e349d2c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3655fd3-ed18-4586-8f69-533fc13a6da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-quobyte-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6" released by "delete_volume" :: held 0.897s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Created reservations ['495f5b9e-9433-4a4f-a0b3-a1556daf69e3', '3ef095d2-d8d8-49a8-9580-908f60c0aa9c', '5a7913e7-ea37-4f02-a562-d39ad3bc2e6a', 'cd966be2-d133-426d-89ec-a928934ee08a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:58 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:15:58 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:59 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.340s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:15:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Deleted volume successfully. Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-753d79d3-9475-4a97-9ed7-8e77b344155b tempest-VolumeDependencyTests-1372587962 None] Lock "cinder-544ae0ad-a6fe-4cb8-9016-0b03a5cf53f6-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3655fd3-ed18-4586-8f69-533fc13a6da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2ba126c-23e4-4393-a85f-09094db80329', 'volume_name': 'volume-f2ba126c-23e4-4393-a85f-09094db80329', 'volume_size': 1, 'image_id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a3c79e6bcacd5cca07245d983a2dba4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55895adeb3e7427086abd6105bfce656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af66ee7bfeeea7ce101bdc15724791e3854f550e3566e2444f599b0268ad8f844835a004b7a1bb5dd7e47470bc54f0f0aca514e12dbbc6d822984031ca0b51a1', 'id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'created_at': datetime.datetime(2026, 7, 17, 5, 15, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3b6e08-59d7-406d-94e9-e70d47e47358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3b6e08-59d7-406d-94e9-e70d47e47358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da2884-11d1-460c-8873-118b33aae316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Volume f2ba126c-23e4-4393-a85f-09094db80329: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2ba126c-23e4-4393-a85f-09094db80329', 'volume_size': 1, 'image_id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a3c79e6bcacd5cca07245d983a2dba4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55895adeb3e7427086abd6105bfce656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af66ee7bfeeea7ce101bdc15724791e3854f550e3566e2444f599b0268ad8f844835a004b7a1bb5dd7e47470bc54f0f0aca514e12dbbc6d822984031ca0b51a1', 'id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'created_at': datetime.datetime(2026, 7, 17, 5, 15, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Trying to clone f2ba126c-23e4-4393-a85f-09094db80329 from image 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b at location (None, [{'url': 'file:///opt/stack/data/glance/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:15:59 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Image download 0.00 MB at 0.00 MB/s Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098aa38-80a4-40c2-bcbe-e26aee75e2b9]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:59 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD Jul 17 07:15:59 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Flow 'volume_create_manager' (a09faca9-76e4-4a1d-81b5-3faf49e2ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2aa142-572e-490c-b5df-67eded49c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2aa142-572e-490c-b5df-67eded49c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-535304179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b08f46-6e25-4b3e-8226-577af35a9243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c63fd2db9d945729d4af94174f6a17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:00Z,use_quota=True,user_id='7da7a2810f5e453f89e3c95013da9527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89380c05-cafa-4510-902e-1d1981b1b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89380c05-cafa-4510-902e-1d1981b1b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc6b866-48c2-4492-a4a4-3f30ec5b21a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc6b866-48c2-4492-a4a4-3f30ec5b21a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b08f46-6e25-4b3e-8226-577af35a9243', 'volume_name': 'volume-70b08f46-6e25-4b3e-8226-577af35a9243', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce50834-f5ab-4749-b53b-7a559b043ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce50834-f5ab-4749-b53b-7a559b043ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02b0e01-2ec4-43a5-b693-ab34d0421c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:15:59 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Volume 70b08f46-6e25-4b3e-8226-577af35a9243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b08f46-6e25-4b3e-8226-577af35a9243', 'volume_size': 1} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-535304179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b08f46-6e25-4b3e-8226-577af35a9243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c63fd2db9d945729d4af94174f6a17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:00Z,use_quota=True,user_id='7da7a2810f5e453f89e3c95013da9527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Creating volume 70b08f46-6e25-4b3e-8226-577af35a9243 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:15:59 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:15:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:15:59 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 1073741824 Jul 17 07:15:59 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:00 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:00 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD Jul 17 07:16:00 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:00 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 1073741824" returned: 0 in 0.685s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:00 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD" returned: 1 in 0.487s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Temporary image 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b is fetched for user bee7eb8c255c40529b7f2f3f4984b3c9. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:00 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 Jul 17 07:16:00 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7442b6e4-fed5-43d8-b8c7-7d1c8ef2f8b5]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:00 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD Jul 17 07:16:00 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:01 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243" returned: 0 in 0.390s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02b0e01-2ec4-43a5-b693-ab34d0421c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b08f46-6e25-4b3e-8226-577af35a9243', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968ab06b-dae9-4c8a-8eb0-0e15c99dda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:01 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Volume volume-70b08f46-6e25-4b3e-8226-577af35a9243 (70b08f46-6e25-4b3e-8226-577af35a9243): created successfully Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968ab06b-dae9-4c8a-8eb0-0e15c99dda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Flow 'volume_create_manager' (a09faca9-76e4-4a1d-81b5-3faf49e2ff55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:01 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-2c950639-af71-4cdd-b6a8-15f26b97409a tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Created volume successfully. Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:01 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Flow 'volume_create_manager' (38ec9812-e11e-42e3-a4fa-9a6828e98c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e5e6f1-a401-45b5-a4b2-dfa4fda37933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e5e6f1-a401-45b5-a4b2-dfa4fda37933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e9b616-8f49-4cd4-96f4-43205c1b11c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c34892a9fd4a2682d9b85291e763dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:01Z,use_quota=True,user_id='0e7ad751623645379dfafdca1ddba179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111ed4b0-69a4-44bf-a9fc-ab0e2b8ac4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111ed4b0-69a4-44bf-a9fc-ab0e2b8ac4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d1f61f-1b76-4198-8753-c15437714851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d1f61f-1b76-4198-8753-c15437714851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e9b616-8f49-4cd4-96f4-43205c1b11c1', 'volume_name': 'volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a8ae3-0061-47a1-ba7e-559c3db40259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a8ae3-0061-47a1-ba7e-559c3db40259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8020ae2b-3fa3-4ef0-93df-16b69e1679d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:01 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Volume b1e9b616-8f49-4cd4-96f4-43205c1b11c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1', 'volume_size': 1} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e9b616-8f49-4cd4-96f4-43205c1b11c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c34892a9fd4a2682d9b85291e763dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:01Z,use_quota=True,user_id='0e7ad751623645379dfafdca1ddba179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Creating volume b1e9b616-8f49-4cd4-96f4-43205c1b11c1 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:01 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:01 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 1073741824 Jul 17 07:16:01 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:01 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD Jul 17 07:16:01 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:01 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:01 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 1073741824" returned: 0 in 0.479s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:01 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 Jul 17 07:16:01 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:02 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ba126c-23e4-4393-a85f-09094db80329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55895adeb3e7427086abd6105bfce656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:15:59Z,use_quota=True,user_id='bee7eb8c255c40529b7f2f3f4984b3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5339f480-94dc-410b-b02f-1ef774429fed),volume_type_id=5339f480-94dc-410b-b02f-1ef774429fed)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Creating volume f2ba126c-23e4-4393-a85f-09094db80329 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:02 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8020ae2b-3fa3-4ef0-93df-16b69e1679d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:02 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 1073741824 Jul 17 07:16:02 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29377435-e9d8-4c3b-b475-300a36990fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:02 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Volume volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 (b1e9b616-8f49-4cd4-96f4-43205c1b11c1): created successfully Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29377435-e9d8-4c3b-b475-300a36990fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Flow 'volume_create_manager' (38ec9812-e11e-42e3-a4fa-9a6828e98c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:02 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f9f33132-74d8-4118-a760-0b3a98a1c683 tempest-CinderUnicodeTest-921817508 None] Created volume successfully. Jul 17 07:16:02 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 1073741824" returned: 0 in 0.596s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:02 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 Jul 17 07:16:02 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-f830218b-3da6-4f50-af12-d5b09ee48524 req-fcb390fd-4882-4f00-8d0a-9bbf32aed174 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:02 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-f830218b-3da6-4f50-af12-d5b09ee48524 req-fcb390fd-4882-4f00-8d0a-9bbf32aed174 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.127s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [req-f830218b-3da6-4f50-af12-d5b09ee48524 req-fcb390fd-4882-4f00-8d0a-9bbf32aed174 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:03 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Attempting download of 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b ((None, [{'url': 'file:///opt/stack/data/glance/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'metadata': {}}])) to volume f2ba126c-23e4-4393-a85f-09094db80329. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:16:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-f830218b-3da6-4f50-af12-d5b09ee48524 req-fcb390fd-4882-4f00-8d0a-9bbf32aed174 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004', 'name': 'volume-70b08f46-6e25-4b3e-8226-577af35a9243', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '326daf42-df37-4226-89d6-50afcda50245', 'enforce_multipath': True} {{(pid=87331) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 17 07:16:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f565f3-d62b-49fc-84de-0743f7ed1256]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:03 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-f830218b-3da6-4f50-af12-d5b09ee48524 req-fcb390fd-4882-4f00-8d0a-9bbf32aed174 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] attachment_update completed successfully. Jul 17 07:16:03 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d Jul 17 07:16:03 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:03 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d" returned: 0 in 0.414s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:03 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d Jul 17 07:16:03 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:04 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Flow 'volume_create_manager' (6cd8e796-fc32-4266-b4cb-ae65a7920678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cb8bb1-2431-4c51-91d4-75bda39de2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d" returned: 1 in 0.629s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_t136di7d' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cb8bb1-2431-4c51-91d4-75bda39de2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1644225673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c739f8-bd40-4f6b-89ac-23f7cbcf5f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c34892a9fd4a2682d9b85291e763dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:04Z,use_quota=True,user_id='0e7ad751623645379dfafdca1ddba179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa5267c-62a1-4afd-afbf-8225403768cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa5267c-62a1-4afd-afbf-8225403768cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719373e9-9902-4b1c-b287-b46916ad1e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719373e9-9902-4b1c-b287-b46916ad1e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c739f8-bd40-4f6b-89ac-23f7cbcf5f04', 'volume_name': 'volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f19cd3-8124-4e23-8807-c05e3ea4c603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f19cd3-8124-4e23-8807-c05e3ea4c603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d47b7ac-56d8-44e5-9969-38601c0a4f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:04 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Volume 95c739f8-bd40-4f6b-89ac-23f7cbcf5f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04', 'volume_size': 1} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1644225673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c739f8-bd40-4f6b-89ac-23f7cbcf5f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c34892a9fd4a2682d9b85291e763dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:04Z,use_quota=True,user_id='0e7ad751623645379dfafdca1ddba179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Creating volume 95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:04 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbacbe7-576b-43bf-b495-e460195ee573]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:04 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 1073741824 Jul 17 07:16:04 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:04 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD Jul 17 07:16:04 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:04 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:04 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD Jul 17 07:16:04 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:04 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 1073741824" returned: 0 in 0.585s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:04 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 Jul 17 07:16:04 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:04 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b was raw, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:16:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:05 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 Jul 17 07:16:05 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:05 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d47b7ac-56d8-44e5-9969-38601c0a4f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1a7035-d30d-4cba-9436-caee4b457f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:05 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Volume volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 (95c739f8-bd40-4f6b-89ac-23f7cbcf5f04): created successfully Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1a7035-d30d-4cba-9436-caee4b457f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Flow 'volume_create_manager' (6cd8e796-fc32-4266-b4cb-ae65a7920678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c49f5357-08ce-4f5e-9f79-b177c5bdbd20 tempest-CinderUnicodeTest-921817508 None] Created volume successfully. Jul 17 07:16:05 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329" returned: 0 in 0.586s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b_ejyc2xsgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:16:05 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:05 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 1G Jul 17 07:16:05 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:05 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 1G" returned: 0 in 0.394s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Downloaded image 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b ((None, [{'url': 'file:///opt/stack/data/glance/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'metadata': {}}])) to volume f2ba126c-23e4-4393-a85f-09094db80329 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Temporary image 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b for user bee7eb8c255c40529b7f2f3f4984b3c9 is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Marking volume f2ba126c-23e4-4393-a85f-09094db80329 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Copying metadata from image 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b to f2ba126c-23e4-4393-a85f-09094db80329. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:16:05 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Creating volume glance metadata for volume f2ba126c-23e4-4393-a85f-09094db80329 backed by image 15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1a3c79e6bcacd5cca07245d983a2dba4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da2884-11d1-460c-8873-118b33aae316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ba126c-23e4-4393-a85f-09094db80329', 'volume_size': 1, 'image_id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a3c79e6bcacd5cca07245d983a2dba4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55895adeb3e7427086abd6105bfce656', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af66ee7bfeeea7ce101bdc15724791e3854f550e3566e2444f599b0268ad8f844835a004b7a1bb5dd7e47470bc54f0f0aca514e12dbbc6d822984031ca0b51a1', 'id': '15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b', 'created_at': datetime.datetime(2026, 7, 17, 5, 15, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15dd8dbb-d9c7-4192-9a77-2b7482c1cf0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3f6fe-0de6-4203-9ff0-b335a2eaadf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:06 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Volume volume-f2ba126c-23e4-4393-a85f-09094db80329 (f2ba126c-23e4-4393-a85f-09094db80329): created successfully Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3f6fe-0de6-4203-9ff0-b335a2eaadf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Flow 'volume_create_manager' (58331b11-3a19-4d80-9779-aad6e305be43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-025275a4-2369-4c89-bad2-e949b2dabb64 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Created volume successfully. Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Creating offline snapshot 4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac of volume 95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c920fe1d-9ea1-44b0-926b-1bee084054bf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:06 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 Jul 17 07:16:06 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [req-41f0b229-1779-4f96-aaf9-97cd0e515108 req-fca60c54-ca6e-4a66-914c-0a3d2627db4e tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Terminate volume connection completed successfully. Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [req-41f0b229-1779-4f96-aaf9-97cd0e515108 req-fca60c54-ca6e-4a66-914c-0a3d2627db4e tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Deleting attachment 326daf42-df37-4226-89d6-50afcda50245. {{(pid=87331) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 17 07:16:06 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:06 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac 1G Jul 17 07:16:06 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Acquiring lock "cinder-f2ba126c-23e4-4393-a85f-09094db80329-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "cinder-f2ba126c-23e4-4393-a85f-09094db80329-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:07 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Acquiring lock "cinder-quobyte-f2ba126c-23e4-4393-a85f-09094db80329" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac 1G" returned: 0 in 0.507s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "cinder-quobyte-f2ba126c-23e4-4393-a85f-09094db80329" acquired by "delete_volume" :: waited 0.053s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:07 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac Jul 17 07:16:07 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e453e-f3d9-4d98-a600-770b7d125f2b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:07 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 Jul 17 07:16:07 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Acquiring lock "cinder-70b08f46-6e25-4b3e-8226-577af35a9243-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "cinder-70b08f46-6e25-4b3e-8226-577af35a9243-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Acquiring lock "cinder-quobyte-70b08f46-6e25-4b3e-8226-577af35a9243" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "cinder-quobyte-70b08f46-6e25-4b3e-8226-577af35a9243" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[444e673a-d228-40ed-9b2a-82dafa08f42f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:07 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" returned: 0 in 0.456s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:07 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac is being set with open permissions: ugo+rw Jul 17 07:16:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:07 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac Jul 17 07:16:07 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 Jul 17 07:16:08 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:08 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329 Jul 17 07:16:08 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" returned: 0 in 0.351s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:08 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f2ba126c-23e4-4393-a85f-09094db80329" returned: 0 in 0.298s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info Jul 17 07:16:08 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "cinder-quobyte-f2ba126c-23e4-4393-a85f-09094db80329" released by "delete_volume" :: held 0.860s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:08 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243" returned: 0 in 0.496s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:08 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243 Jul 17 07:16:08 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack cinder-volume[87331]: WARNING cinder.quota [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:16:08 devstack cinder-volume[87331]: WARNING cinder.quota [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Created reservations ['24b81f16-56c9-4de4-881e-df1a8ffb95ff', '4ae1b554-ab18-4ec5-a724-4f7df1454e6b', '0e136329-888c-4198-ba76-d6b15e69388a', 'ec3106db-be88-4c92-825b-bc3710396c0e'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:08 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:08 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-70b08f46-6e25-4b3e-8226-577af35a9243" returned: 0 in 0.314s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "cinder-quobyte-70b08f46-6e25-4b3e-8226-577af35a9243" released by "delete_volume" :: held 0.868s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:08 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info is being set with open permissions: ugo+rw Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:08 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info Jul 17 07:16:08 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Created reservations ['eb60e71f-1e5d-4bdf-83a3-cad08ca66e0a', '606abfbb-3035-435c-85a1-aef7f854cdf3', 'a3ed83fd-e628-4fe2-80b5-408fe51ea77f', '295fd678-7e27-4c0d-a272-19977e7c64f1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:08 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:08 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Deleted volume successfully. Jul 17 07:16:08 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:08 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fca69355-0c18-4713-86c5-3075c5cab422 tempest-VolumeAndVolumeTypeFromImageTest-412350737 None] Lock "cinder-f2ba126c-23e4-4393-a85f-09094db80329-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:09 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.info" returned: 0 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-08fe46b8-6dfc-4d94-a1fa-7764ecce397c tempest-CinderUnicodeTest-921817508 None] Create snapshot completed successfully Jul 17 07:16:09 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Deleted volume successfully. Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f91db2b-9213-4cdb-864f-12b8a5921651 tempest-TestServerVolumeAttachScenarioOldVersion-40126825 None] Lock "cinder-70b08f46-6e25-4b3e-8226-577af35a9243-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-quobyte-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-quobyte-4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Deleting offline snapshot 4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac of volume 95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] snapshot_file for this snap is: volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30df24-98a9-4aaa-b7a7-058debda8f4d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:10 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac Jul 17 07:16:10 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:10 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" returned: 0 in 0.524s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:16:10 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0706f80a-cdad-430d-b1c4-e3a03488bacb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:10 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 Jul 17 07:16:10 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:11 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" returned: 0 in 0.858s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:11 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac Jul 17 07:16:11 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:11 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" returned: 0 in 0.395s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:11 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac Jul 17 07:16:11 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:12 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04.4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" returned: 0 in 0.368s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac" released by "_delete_snapshot" :: held 2.356s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" released by "delete_snapshot" :: held 2.385s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:12 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Created reservations ['5cd558d6-298c-4704-ad75-55619778278c', '07e73859-cf10-4f1a-a4e5-ee157ad42586', '9288ab54-5232-4f6f-9605-4877f07eeb5f', 'f8216e3f-cf8a-468f-aaeb-22ba8ff98bd2'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:12 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Delete snapshot completed successfully. Jul 17 07:16:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f218f3eb-f4d2-406c-a813-0fff54b05636 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-4e426ed3-de69-4a4c-9b8d-c9a232b5e0ac-delete_snapshot" released by "delete_snapshot" :: held 2.568s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-quobyte-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3232d5-cc2b-4ef3-a3a6-5874702e8c7b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:13 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 Jul 17 07:16:13 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:13 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" returned: 0 in 0.491s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:13 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04 Jul 17 07:16:13 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:14 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" returned: 0 in 0.321s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04" released by "delete_volume" :: held 0.882s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Created reservations ['456646a1-00d2-422d-9266-9e50d6e47e0f', '8e99666b-68b7-48d6-b1a3-2bec84caddcd', 'a40967d7-4b39-4f81-9612-d14b37c4e087', '0dfa5ab4-9da7-43f3-9d69-5b89b966d9df'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:14 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:14 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-b1e9b616-8f49-4cd4-96f4-43205c1b11c1-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-b1e9b616-8f49-4cd4-96f4-43205c1b11c1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "cinder-quobyte-b1e9b616-8f49-4cd4-96f4-43205c1b11c1" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-b1e9b616-8f49-4cd4-96f4-43205c1b11c1" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf66bbb0-1231-4f84-b896-2a0a549e4ff8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:14 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:14 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 Jul 17 07:16:14 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Deleted volume successfully. Jul 17 07:16:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-16272fd1-15d9-4f64-9ebc-8dd87b901909 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-95c739f8-bd40-4f6b-89ac-23f7cbcf5f04-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:15 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1" returned: 0 in 0.469s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:15 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1 Jul 17 07:16:15 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:15 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1e9b616-8f49-4cd4-96f4-43205c1b11c1" returned: 0 in 0.447s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-quobyte-b1e9b616-8f49-4cd4-96f4-43205c1b11c1" released by "delete_volume" :: held 1.000s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Created reservations ['14e89075-8745-443e-a910-d46e714fd530', '8313cf53-e1e6-4fe4-8a09-2a3b7c60f1fa', '76dd9795-9690-4b3c-869b-967775f8e101', 'd7dafda7-73ee-4216-b1a4-6e205f9d6668'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:15 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:15 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:16 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.329s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Deleted volume successfully. Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-839f54e5-6212-452f-b8ee-51b7e53e1d72 tempest-CinderUnicodeTest-921817508 None] Lock "cinder-b1e9b616-8f49-4cd4-96f4-43205c1b11c1-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (47ec3d7b-5ffe-4453-86d9-20645e2c12e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9554fdbd-fabf-41b7-acff-650fe86d0a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9554fdbd-fabf-41b7-acff-650fe86d0a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1146156686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152e3998-fbfd-4520-b619-edceb3292180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:16Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bb6f91-e6bc-42e8-8898-ec40f83f2c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2bb6f91-e6bc-42e8-8898-ec40f83f2c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0118a08-0c87-4a59-9a60-3d20e64ffdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0118a08-0c87-4a59-9a60-3d20e64ffdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152e3998-fbfd-4520-b619-edceb3292180', 'volume_name': 'volume-152e3998-fbfd-4520-b619-edceb3292180', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82f0b14-72de-4726-9da3-2169e5ad40d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82f0b14-72de-4726-9da3-2169e5ad40d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f5e179-357d-46d1-8e85-7081078c6100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Volume 152e3998-fbfd-4520-b619-edceb3292180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152e3998-fbfd-4520-b619-edceb3292180', 'volume_size': 1} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1146156686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152e3998-fbfd-4520-b619-edceb3292180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:16Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Creating volume 152e3998-fbfd-4520-b619-edceb3292180 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:16 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:16 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 1073741824 Jul 17 07:16:16 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (bc01fc7f-3b87-4aba-9e32-1cd37370fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a03d6c5-1185-46da-bebe-8033594192c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a03d6c5-1185-46da-bebe-8033594192c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113371901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468315a5-6e2e-41c1-b9de-9254bfb96d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:17Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed790d69-fd98-4d90-a16d-90e24a62e9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed790d69-fd98-4d90-a16d-90e24a62e9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ad9c62-43a7-4b66-9691-fa9b8259a66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ad9c62-43a7-4b66-9691-fa9b8259a66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468315a5-6e2e-41c1-b9de-9254bfb96d26', 'volume_name': 'volume-468315a5-6e2e-41c1-b9de-9254bfb96d26', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f9c882-9241-4ea5-8bda-7effa92eaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f9c882-9241-4ea5-8bda-7effa92eaaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe33f9c-3d1c-4783-a69f-930e9a4adf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Volume 468315a5-6e2e-41c1-b9de-9254bfb96d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468315a5-6e2e-41c1-b9de-9254bfb96d26', 'volume_size': 1} Jul 17 07:16:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:17 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 1073741824" returned: 0 in 0.764s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:17 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 Jul 17 07:16:17 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (a8612bcd-1c51-4a57-a8c6-1a659b86fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5311137-93cc-4b7e-b314-d526ad89ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5311137-93cc-4b7e-b314-d526ad89ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1074285848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a775ded5-9287-491d-8d26-002fb738a1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:17Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3ccb9d-f0c0-4698-a313-68b7a761eadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3ccb9d-f0c0-4698-a313-68b7a761eadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df69b3e8-1137-4abc-b421-7bb039335452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df69b3e8-1137-4abc-b421-7bb039335452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a775ded5-9287-491d-8d26-002fb738a1b7', 'volume_name': 'volume-a775ded5-9287-491d-8d26-002fb738a1b7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:17 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed3ba02-63fe-49a5-ac0f-b74f86c70e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed3ba02-63fe-49a5-ac0f-b74f86c70e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cedf63-23c8-4493-bbb7-2e5a9732050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Volume a775ded5-9287-491d-8d26-002fb738a1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a775ded5-9287-491d-8d26-002fb738a1b7', 'volume_size': 1} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113371901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468315a5-6e2e-41c1-b9de-9254bfb96d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:17Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Creating volume 468315a5-6e2e-41c1-b9de-9254bfb96d26 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:17 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f5e179-357d-46d1-8e85-7081078c6100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152e3998-fbfd-4520-b619-edceb3292180', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97bd686-d330-43d2-9ebc-f5ecb251c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:17 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 1073741824 Jul 17 07:16:17 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Volume volume-152e3998-fbfd-4520-b619-edceb3292180 (152e3998-fbfd-4520-b619-edceb3292180): created successfully Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97bd686-d330-43d2-9ebc-f5ecb251c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (47ec3d7b-5ffe-4453-86d9-20645e2c12e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4f2bf85a-964c-463d-9d64-0e43e6e4b05a tempest-CreateVolumesFromImageTest-1922793893 None] Created volume successfully. Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (9050a274-4aab-4a42-b305-74192b4a5c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1e197a-1b20-4883-8d3d-d2c8158120be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1e197a-1b20-4883-8d3d-d2c8158120be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1102034521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3125ef-9a2f-4c8c-986b-00d9b5472b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:18Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea88b34-f291-43a7-8795-06354d0c52d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea88b34-f291-43a7-8795-06354d0c52d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9d092f-c4f3-4a37-a602-e4d2a2566964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9d092f-c4f3-4a37-a602-e4d2a2566964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3125ef-9a2f-4c8c-986b-00d9b5472b7c', 'volume_name': 'volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff3982c-1952-4f76-a1a3-cc5b7c6a8580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff3982c-1952-4f76-a1a3-cc5b7c6a8580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97144070-0f94-4426-950b-953c84e8f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Volume 8d3125ef-9a2f-4c8c-986b-00d9b5472b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c', 'volume_size': 1} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 1073741824" returned: 0 in 0.701s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:18 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 Jul 17 07:16:18 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:18 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26" returned: 0 in 0.363s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.128s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1074285848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a775ded5-9287-491d-8d26-002fb738a1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:17Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Creating volume a775ded5-9287-491d-8d26-002fb738a1b7 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:18 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe33f9c-3d1c-4783-a69f-930e9a4adf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468315a5-6e2e-41c1-b9de-9254bfb96d26', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4891dc5-3d79-4676-baf6-06b1f8fe9da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 1073741824 Jul 17 07:16:18 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (f8675a58-2cf3-4345-90f2-74d1f74aa327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc97e69b-b2d6-4c54-987f-c4fadd4e46e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Volume volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 (468315a5-6e2e-41c1-b9de-9254bfb96d26): created successfully Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4891dc5-3d79-4676-baf6-06b1f8fe9da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (bc01fc7f-3b87-4aba-9e32-1cd37370fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc97e69b-b2d6-4c54-987f-c4fadd4e46e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855824384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bc48ca-1417-49d8-befb-4c0fb592982d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:19Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803bc738-4520-4185-b8f5-70a51ca91456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803bc738-4520-4185-b8f5-70a51ca91456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f4ed00-f5c8-41dc-ba96-9dba8997052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f4ed00-f5c8-41dc-ba96-9dba8997052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99bc48ca-1417-49d8-befb-4c0fb592982d', 'volume_name': 'volume-99bc48ca-1417-49d8-befb-4c0fb592982d', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01a8e23-1335-42e6-93fa-c091fa97301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01a8e23-1335-42e6-93fa-c091fa97301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdeeeee0-59e4-4085-9a9e-baeffcce1b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Volume 99bc48ca-1417-49d8-befb-4c0fb592982d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99bc48ca-1417-49d8-befb-4c0fb592982d', 'volume_size': 1} Jul 17 07:16:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-80edf5be-dab9-4ffb-aeee-bb9fdaaeb911 tempest-CreateVolumesFromImageTest-1922793893 None] Created volume successfully. Jul 17 07:16:19 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 1073741824" returned: 0 in 0.664s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:19 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 Jul 17 07:16:19 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:19 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7" returned: 0 in 0.303s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1102034521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3125ef-9a2f-4c8c-986b-00d9b5472b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:18Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Creating volume 8d3125ef-9a2f-4c8c-986b-00d9b5472b7c {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:19 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cedf63-23c8-4493-bbb7-2e5a9732050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a775ded5-9287-491d-8d26-002fb738a1b7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:19 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c 1073741824 Jul 17 07:16:19 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb383b72-e7ac-4553-9e12-5a4f30bb41e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Volume volume-a775ded5-9287-491d-8d26-002fb738a1b7 (a775ded5-9287-491d-8d26-002fb738a1b7): created successfully Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb383b72-e7ac-4553-9e12-5a4f30bb41e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (a8612bcd-1c51-4a57-a8c6-1a659b86fab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a515beba-0d9c-46cd-ac33-19c0ce0c14c9 tempest-CreateVolumesFromImageTest-1922793893 None] Created volume successfully. Jul 17 07:16:20 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c 1073741824" returned: 0 in 0.610s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:20 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c Jul 17 07:16:20 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:20 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c" returned: 0 in 0.347s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855824384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99bc48ca-1417-49d8-befb-4c0fb592982d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795c8a01d0ba40e989bfecd5aab345be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:19Z,use_quota=True,user_id='ce56ae86af0240389cc229dd22e4a8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Creating volume 99bc48ca-1417-49d8-befb-4c0fb592982d {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:20 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:20 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d 1073741824 Jul 17 07:16:20 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97144070-0f94-4426-950b-953c84e8f050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314e099e-e80a-41b0-9811-bafb6be9c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:20 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Volume volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c (8d3125ef-9a2f-4c8c-986b-00d9b5472b7c): created successfully Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314e099e-e80a-41b0-9811-bafb6be9c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (9050a274-4aab-4a42-b305-74192b4a5c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6436a396-51b7-4e07-8f26-3ce4691d043a tempest-CreateVolumesFromImageTest-1922793893 None] Created volume successfully. Jul 17 07:16:21 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d 1073741824" returned: 0 in 0.629s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:21 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d Jul 17 07:16:21 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:21 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d" returned: 0 in 0.374s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdeeeee0-59e4-4085-9a9e-baeffcce1b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99bc48ca-1417-49d8-befb-4c0fb592982d', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afefd5e7-0f8a-44b2-8fa2-993fcbf1451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:21 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Volume volume-99bc48ca-1417-49d8-befb-4c0fb592982d (99bc48ca-1417-49d8-befb-4c0fb592982d): created successfully Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afefd5e7-0f8a-44b2-8fa2-993fcbf1451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Flow 'volume_create_manager' (f8675a58-2cf3-4345-90f2-74d1f74aa327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8796d7ce-47d7-47b5-be32-4c9392fa78c3 tempest-CreateVolumesFromImageTest-1922793893 None] Created volume successfully. Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-99bc48ca-1417-49d8-befb-4c0fb592982d-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-99bc48ca-1417-49d8-befb-4c0fb592982d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-quobyte-99bc48ca-1417-49d8-befb-4c0fb592982d" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-99bc48ca-1417-49d8-befb-4c0fb592982d" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e082a7ce-ff73-432b-9b74-5744bea327a2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:22 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d Jul 17 07:16:22 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:23 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d" returned: 0 in 0.492s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:23 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d Jul 17 07:16:23 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:23 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99bc48ca-1417-49d8-befb-4c0fb592982d" returned: 0 in 0.377s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-99bc48ca-1417-49d8-befb-4c0fb592982d" released by "delete_volume" :: held 0.952s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Created reservations ['85620839-82ab-4e6a-8838-e4faa28a30bb', 'de7f6e42-8805-4ac4-9df0-4b529af91d26', 'c4b452b6-5c45-489e-a2c3-93a82adce8cd', '613d7b2f-8fdd-49e5-9e0c-a734c30d9c0c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:23 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:23 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:24 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:24 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Deleted volume successfully. Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e829e431-7aad-424e-91b4-ff2bc54fbead tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-99bc48ca-1417-49d8-befb-4c0fb592982d-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-quobyte-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd0ec8-a631-448a-8fd1-0b3a92695a7b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:25 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c Jul 17 07:16:25 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:25 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c" returned: 0 in 0.522s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:25 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c Jul 17 07:16:25 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:25 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c" returned: 0 in 0.332s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c" released by "delete_volume" :: held 0.941s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:25 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Created reservations ['3769e58f-994a-4d36-becd-41bace383c0b', 'de1f42f5-48f9-4078-835f-9cbc3feea241', '004b090d-d150-458f-aa7b-81966da9ce89', 'b63ae1e7-9347-4c76-92f5-4c42f10492d5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:26 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:26 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:26 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Deleted volume successfully. Jul 17 07:16:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-73ffef4b-2f3d-4544-9cd7-755b66a4b5a1 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-8d3125ef-9a2f-4c8c-986b-00d9b5472b7c-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-a775ded5-9287-491d-8d26-002fb738a1b7-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-a775ded5-9287-491d-8d26-002fb738a1b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-quobyte-a775ded5-9287-491d-8d26-002fb738a1b7" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-a775ded5-9287-491d-8d26-002fb738a1b7" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf23a9-2f79-4214-88ed-335cf8417e6d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:27 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 Jul 17 07:16:27 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:27 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:27 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7 Jul 17 07:16:27 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:28 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-a775ded5-9287-491d-8d26-002fb738a1b7" returned: 0 in 0.272s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-a775ded5-9287-491d-8d26-002fb738a1b7" released by "delete_volume" :: held 0.801s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Created reservations ['ee4924b6-8b5d-4028-920d-3127e144560d', '8e1df937-e0ef-4311-9607-9151467ae79f', '79f18a89-8ecf-49a6-84b6-2ec5ec7c3471', '3b0aaf8b-5ff6-428e-ad31-4596f6724a08'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:28 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:28 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-468315a5-6e2e-41c1-b9de-9254bfb96d26-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-468315a5-6e2e-41c1-b9de-9254bfb96d26-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-quobyte-468315a5-6e2e-41c1-b9de-9254bfb96d26" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:28 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-468315a5-6e2e-41c1-b9de-9254bfb96d26" acquired by "delete_volume" :: waited 0.051s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Deleted volume successfully. Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb732b-a899-43a2-b84d-a9ef1ea73766]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-523ffbda-ce05-49bf-b586-353f608f7808 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-a775ded5-9287-491d-8d26-002fb738a1b7-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:28 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 Jul 17 07:16:28 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:29 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26" returned: 0 in 0.468s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:29 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26 Jul 17 07:16:29 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:29 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-468315a5-6e2e-41c1-b9de-9254bfb96d26" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-468315a5-6e2e-41c1-b9de-9254bfb96d26" released by "delete_volume" :: held 0.917s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Created reservations ['53a812ee-fa07-4faa-a82d-91e62c20379b', 'dfbd6533-7771-4c50-8f44-993992e46d84', '9b841c62-acee-4101-b9d1-9403f3580042', 'f41fbb55-6d45-4406-ab7a-62503d52c79b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:29 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:29 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:29 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:29 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:30 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.344s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:30 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Deleted volume successfully. Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bb6d24be-4a5f-4927-9054-5fe842ea9e8f tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-468315a5-6e2e-41c1-b9de-9254bfb96d26-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:30 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.346s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-152e3998-fbfd-4520-b619-edceb3292180-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-152e3998-fbfd-4520-b619-edceb3292180-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "cinder-quobyte-152e3998-fbfd-4520-b619-edceb3292180" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-152e3998-fbfd-4520-b619-edceb3292180" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610d48f-b32c-45bd-8b9e-858be13f777d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:31 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 Jul 17 07:16:31 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:31 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:31 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180 Jul 17 07:16:31 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:31 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-152e3998-fbfd-4520-b619-edceb3292180" returned: 0 in 0.374s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-quobyte-152e3998-fbfd-4520-b619-edceb3292180" released by "delete_volume" :: held 0.874s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:31 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Created reservations ['5d42d346-c3fc-47ac-a85b-0d65eb0e8345', '08b33d1a-498e-4ef7-bb7f-fa2d2541b4c9', '7236695a-80e7-4032-8684-d881e1e84d04', 'b7b7a524-9855-46bc-b138-5e10eb6b7a16'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:32 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:32 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:32 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Deleted volume successfully. Jul 17 07:16:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-053fff87-2a0d-4a64-8e00-608346bfd9c5 tempest-CreateVolumesFromImageTest-1922793893 None] Lock "cinder-152e3998-fbfd-4520-b619-edceb3292180-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (7d1169df-5d48-4fb8-86b3-6015ecc09a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2193c029-e7e1-491a-affe-6e58080c0eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2193c029-e7e1-491a-affe-6e58080c0eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510613290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba0260e-ac04-421e-8d72-5c5e6e16fc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:33Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5860bf92-2a3f-4349-9fcb-5991af232d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5860bf92-2a3f-4349-9fcb-5991af232d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0565e64e-8916-49e2-be1d-4161b21eda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0565e64e-8916-49e2-be1d-4161b21eda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba0260e-ac04-421e-8d72-5c5e6e16fc54', 'volume_name': 'volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0709425a-2f2d-47f5-9841-e005e02f56ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0709425a-2f2d-47f5-9841-e005e02f56ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cfc597-d7fe-47a1-a9ce-59b010906650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:33 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Volume 9ba0260e-ac04-421e-8d72-5c5e6e16fc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54', 'volume_size': 1} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510613290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba0260e-ac04-421e-8d72-5c5e6e16fc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:33Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Creating volume 9ba0260e-ac04-421e-8d72-5c5e6e16fc54 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:33 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:33 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 1073741824 Jul 17 07:16:33 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:34 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 1073741824" returned: 0 in 0.705s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:34 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 Jul 17 07:16:34 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:34 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54" returned: 0 in 0.335s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cfc597-d7fe-47a1-a9ce-59b010906650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c0c216-d746-4d07-99e7-435fffc35848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Volume volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 (9ba0260e-ac04-421e-8d72-5c5e6e16fc54): created successfully Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c0c216-d746-4d07-99e7-435fffc35848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (7d1169df-5d48-4fb8-86b3-6015ecc09a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c8734429-7f17-4b3a-9949-8835b07ab417 tempest-ProjectReaderTests-2032111384 None] Created volume successfully. Jul 17 07:16:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-9ba0260e-ac04-421e-8d72-5c5e6e16fc54-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-9ba0260e-ac04-421e-8d72-5c5e6e16fc54-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-quobyte-9ba0260e-ac04-421e-8d72-5c5e6e16fc54" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-9ba0260e-ac04-421e-8d72-5c5e6e16fc54" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa51eac9-df93-477a-a16a-0bf53ee074da]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:35 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 Jul 17 07:16:35 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:36 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54" returned: 0 in 0.467s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:36 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54 Jul 17 07:16:36 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:36 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9ba0260e-ac04-421e-8d72-5c5e6e16fc54" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-9ba0260e-ac04-421e-8d72-5c5e6e16fc54" released by "delete_volume" :: held 0.939s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Created reservations ['d8a08d42-a37e-441c-85a6-91aa21095196', 'dc3e5976-4820-4480-aa2f-cade7957b8dd', 'a0a4f7e8-6db9-456a-abdc-73020d531222', '64703144-8b71-4134-8e15-ed5265df781a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:36 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:36 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:37 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.330s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:37 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Deleted volume successfully. Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6ab2220b-d208-47be-929b-fa8f0ba0cbc3 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-9ba0260e-ac04-421e-8d72-5c5e6e16fc54-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Flow 'volume_create_manager' (e6526511-effb-4f40-8dd7-c6c2360191ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678e6b2b-a8b2-4f68-8c41-51cb3ca3c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678e6b2b-a8b2-4f68-8c41-51cb3ca3c08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2385f26c-71b5-488b-a9c6-337e3a652670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964e00fdcede4db692ecb9635ebfc790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:38Z,use_quota=True,user_id='afc850aff8b246dd90c0b229d842b7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71306096-368e-4575-80a8-721e22f3ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71306096-368e-4575-80a8-721e22f3ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20173040-cbd6-4d18-adac-0ea322612575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:37 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20173040-cbd6-4d18-adac-0ea322612575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2385f26c-71b5-488b-a9c6-337e3a652670', 'volume_name': 'volume-2385f26c-71b5-488b-a9c6-337e3a652670', 'volume_size': 1, 'image_id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a93bc8cd-331a-497d-9575-c81df5307289', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '109ffc296042dd4a78521e05ec3a10d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '964e00fdcede4db692ecb9635ebfc790', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa958ab9b41cc54c70b167164f6a36b9922628e494661ca3316c72d3fb6d42c1f262c888564dd8229c5c99c1f2eabbe700aa92ab9e6ce4c7b5f81d29eb9aada1', 'id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'created_at': datetime.datetime(2026, 7, 17, 5, 16, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 16, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a93bc8cd-331a-497d-9575-c81df5307289/file', 'properties': {}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f7e49a-84f6-4df1-b9d3-c18f4959dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f7e49a-84f6-4df1-b9d3-c18f4959dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6b6091-264d-4084-88c5-6626f8d99167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Volume 2385f26c-71b5-488b-a9c6-337e3a652670: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2385f26c-71b5-488b-a9c6-337e3a652670', 'volume_size': 1, 'image_id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a93bc8cd-331a-497d-9575-c81df5307289', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '109ffc296042dd4a78521e05ec3a10d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '964e00fdcede4db692ecb9635ebfc790', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa958ab9b41cc54c70b167164f6a36b9922628e494661ca3316c72d3fb6d42c1f262c888564dd8229c5c99c1f2eabbe700aa92ab9e6ce4c7b5f81d29eb9aada1', 'id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'created_at': datetime.datetime(2026, 7, 17, 5, 16, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 16, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a93bc8cd-331a-497d-9575-c81df5307289/file', 'properties': {}}, 'image_service': } Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Trying to clone 2385f26c-71b5-488b-a9c6-337e3a652670 from image a93bc8cd-331a-497d-9575-c81df5307289 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a93bc8cd-331a-497d-9575-c81df5307289', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:16:38 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Image download 0.00 MB at 0.00 MB/s Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[401213ba-bb53-4ca5-a784-3a59fc44b8ba]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (0fe69fae-78cf-4e0f-9f71-2cd950ade185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4b9be3-3dec-492c-a100-c19877942d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4b9be3-3dec-492c-a100-c19877942d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766445365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b7ceea-dc24-4956-bdff-564c8a08c4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:39Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2afeae-80da-474d-9a75-4038f60269c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2afeae-80da-474d-9a75-4038f60269c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d56eb5-bce4-4e6f-9f9e-92667504d194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d56eb5-bce4-4e6f-9f9e-92667504d194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b7ceea-dc24-4956-bdff-564c8a08c4c4', 'volume_name': 'volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5073ad-c301-4ea7-a7da-5da327e0272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5073ad-c301-4ea7-a7da-5da327e0272f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4808b9af-c6bc-4111-a638-46668bb1c249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Volume f5b7ceea-dc24-4956-bdff-564c8a08c4c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4', 'volume_size': 1} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1766445365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b7ceea-dc24-4956-bdff-564c8a08c4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:39Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Creating volume f5b7ceea-dc24-4956-bdff-564c8a08c4c4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:38 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:38 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 1073741824 Jul 17 07:16:38 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:38 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD Jul 17 07:16:38 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Flow 'volume_create_manager' (bd85ca64-dfe0-49db-981b-7bb24707eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a85285-2003-4175-90b9-34cbbb09c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a85285-2003-4175-90b9-34cbbb09c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-32437188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82f6dd-e3fc-48ac-8abd-54e1606d2248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4104441149ba4d1fb5e54326bc30031f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:39Z,use_quota=True,user_id='75f7854a03504106abce2bdf62af4bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fc1cb1-84e1-46d1-a3bf-755350ded043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fc1cb1-84e1-46d1-a3bf-755350ded043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8471dd83-7e42-4a95-9366-bd85e2a03977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8471dd83-7e42-4a95-9366-bd85e2a03977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea82f6dd-e3fc-48ac-8abd-54e1606d2248', 'volume_name': 'volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5941a7f-9815-4377-afb2-1e3cc645e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5941a7f-9815-4377-afb2-1e3cc645e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc23f71-ec78-44e0-b91b-c6882f7614b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Volume ea82f6dd-e3fc-48ac-8abd-54e1606d2248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248', 'volume_size': 1} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:39 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:39 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD Jul 17 07:16:39 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:39 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 1073741824" returned: 0 in 0.549s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:39 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 Jul 17 07:16:39 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:39 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Temporary image a93bc8cd-331a-497d-9575-c81df5307289 is fetched for user afc850aff8b246dd90c0b229d842b7bd. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de50191-1feb-4507-a964-5e6611c03343]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:39 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:39 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD Jul 17 07:16:39 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-32437188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82f6dd-e3fc-48ac-8abd-54e1606d2248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4104441149ba4d1fb5e54326bc30031f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:39Z,use_quota=True,user_id='75f7854a03504106abce2bdf62af4bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Creating volume ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:39 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:39 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 1073741824 Jul 17 07:16:39 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4808b9af-c6bc-4111-a638-46668bb1c249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbb6b32-1b84-4db2-9647-a4153f0ff828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Volume volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 (f5b7ceea-dc24-4956-bdff-564c8a08c4c4): created successfully Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbb6b32-1b84-4db2-9647-a4153f0ff828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (0fe69fae-78cf-4e0f-9f71-2cd950ade185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-134c01c6-e42d-4c31-99a9-60466524f0b6 tempest-ProjectReaderTests-2032111384 None] Created volume successfully. Jul 17 07:16:39 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:40 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD Jul 17 07:16:40 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:40 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 1073741824" returned: 0 in 0.546s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:40 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:40 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:40 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:40 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2385f26c-71b5-488b-a9c6-337e3a652670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964e00fdcede4db692ecb9635ebfc790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:38Z,use_quota=True,user_id='afc850aff8b246dd90c0b229d842b7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Creating volume 2385f26c-71b5-488b-a9c6-337e3a652670 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:40 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc23f71-ec78-44e0-b91b-c6882f7614b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3491d6a6-1b97-4235-80a4-d7b232522967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:40 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 1073741824 Jul 17 07:16:40 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Volume volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 (ea82f6dd-e3fc-48ac-8abd-54e1606d2248): created successfully Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3491d6a6-1b97-4235-80a4-d7b232522967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Flow 'volume_create_manager' (bd85ca64-dfe0-49db-981b-7bb24707eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f5a582ab-ddbc-4175-97b1-44ead883743e tempest-SnapshotDependencyTests-1517301488 None] Created volume successfully. Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-f5b7ceea-dc24-4956-bdff-564c8a08c4c4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-f5b7ceea-dc24-4956-bdff-564c8a08c4c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-quobyte-f5b7ceea-dc24-4956-bdff-564c8a08c4c4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-f5b7ceea-dc24-4956-bdff-564c8a08c4c4" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c7db3-4f40-4cfe-8ff1-134d13aec0ca]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:41 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 Jul 17 07:16:41 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:41 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 1073741824" returned: 0 in 0.616s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:41 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 Jul 17 07:16:41 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:41 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4" returned: 0 in 0.529s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:41 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4 Jul 17 07:16:41 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:41 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670" returned: 0 in 0.331s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.140s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Creating offline snapshot f34a7369-b54d-4af7-8b97-24f11cca928b of volume ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Attempting download of a93bc8cd-331a-497d-9575-c81df5307289 ((None, [{'url': 'file:///opt/stack/data/glance/images/a93bc8cd-331a-497d-9575-c81df5307289', 'metadata': {}}])) to volume 2385f26c-71b5-488b-a9c6-337e3a652670. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5493faca-20fa-422e-b154-2ea1908b5230]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1486e6c-a528-4a3c-8060-470a35b300fc]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:41 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:41 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:41 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f5b7ceea-dc24-4956-bdff-564c8a08c4c4" returned: 0 in 0.292s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:41 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0 Jul 17 07:16:41 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-f5b7ceea-dc24-4956-bdff-564c8a08c4c4" released by "delete_volume" :: held 0.873s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=148,cinder:UPDATE=211,cinder:DELETE=19,cinder:INSERT=53 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Created reservations ['27a298ab-279c-4e58-bd9b-a1827fd07730', 'dafcd65b-ec21-452a-923e-e6a7e32350d5', '5cb588c5-3cca-48f2-8396-042947f5784b', 'd2f0c88f-8172-4aa7-8df6-6aaf431db160'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:41 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:41 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:42 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0" returned: 0 in 0.439s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.522s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:42 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b 1G Jul 17 07:16:42 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:42 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0 Jul 17 07:16:42 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:42 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.336s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Deleted volume successfully. Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b2794733-51d2-4aa3-a2c6-7830a70e3908 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-f5b7ceea-dc24-4956-bdff-564c8a08c4c4-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:42 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0" returned: 1 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a93bc8cd-331a-497d-9575-c81df5307289_r2u6o1_0' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e05dea6-7f5e-483d-8557-b125cd67244e]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (e16b5210-228b-4453-8328-2d0c8dee69d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:42 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b80c1-9c94-4db6-8a3a-5c8d0fb9fd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:42 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD Jul 17 07:16:42 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b 1G" returned: 0 in 0.519s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b80c1-9c94-4db6-8a3a-5c8d0fb9fd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16243623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b120e174-aebe-4824-ba7d-406eff209c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:43Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a8b9e4-75a4-4284-9ef9-18670b3e92c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:42 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b Jul 17 07:16:42 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a8b9e4-75a4-4284-9ef9-18670b3e92c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89425b5-a385-4cd4-811a-fa697189a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89425b5-a385-4cd4-811a-fa697189a363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b120e174-aebe-4824-ba7d-406eff209c75', 'volume_name': 'volume-b120e174-aebe-4824-ba7d-406eff209c75', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d505d1b3-bf93-4042-811c-1e53f38006d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d505d1b3-bf93-4042-811c-1e53f38006d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a15c57-ff7d-4eab-b8af-13751eaa7605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:42 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Volume b120e174-aebe-4824-ba7d-406eff209c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b120e174-aebe-4824-ba7d-406eff209c75', 'volume_size': 1} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:42 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:42 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD Jul 17 07:16:42 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:42 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b" returned: 0 in 0.348s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:42 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b is being set with open permissions: ugo+rw Jul 17 07:16:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:42 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b Jul 17 07:16:42 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:43 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] a93bc8cd-331a-497d-9575-c81df5307289 was raw, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:43 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 Jul 17 07:16:43 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:43 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b" returned: 0 in 0.266s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:43 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info Jul 17 07:16:43 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:43 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info" returned: 0 in 0.277s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:43 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info is being set with open permissions: ugo+rw Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:43 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info Jul 17 07:16:43 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:43 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670" returned: 0 in 0.457s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a93bc8cd-331a-497d-9575-c81df5307289__b0qo8zldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:16:43 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:43 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 1G Jul 17 07:16:43 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:43 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.info" returned: 0 in 0.257s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16243623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b120e174-aebe-4824-ba7d-406eff209c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:43Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Creating volume b120e174-aebe-4824-ba7d-406eff209c75 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:43 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 1073741824 Jul 17 07:16:43 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b438f509-81a5-4326-b952-26cbee74f30a tempest-SnapshotDependencyTests-1517301488 None] Create snapshot completed successfully Jul 17 07:16:43 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 1G" returned: 0 in 0.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Downloaded image a93bc8cd-331a-497d-9575-c81df5307289 ((None, [{'url': 'file:///opt/stack/data/glance/images/a93bc8cd-331a-497d-9575-c81df5307289', 'metadata': {}}])) to volume 2385f26c-71b5-488b-a9c6-337e3a652670 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Temporary image a93bc8cd-331a-497d-9575-c81df5307289 for user afc850aff8b246dd90c0b229d842b7bd is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Marking volume 2385f26c-71b5-488b-a9c6-337e3a652670 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Copying metadata from image a93bc8cd-331a-497d-9575-c81df5307289 to 2385f26c-71b5-488b-a9c6-337e3a652670. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:16:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Creating volume glance metadata for volume 2385f26c-71b5-488b-a9c6-337e3a652670 backed by image a93bc8cd-331a-497d-9575-c81df5307289 with: {'image_id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '109ffc296042dd4a78521e05ec3a10d8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6b6091-264d-4084-88c5-6626f8d99167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2385f26c-71b5-488b-a9c6-337e3a652670', 'volume_size': 1, 'image_id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a93bc8cd-331a-497d-9575-c81df5307289', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '109ffc296042dd4a78521e05ec3a10d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '964e00fdcede4db692ecb9635ebfc790', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa958ab9b41cc54c70b167164f6a36b9922628e494661ca3316c72d3fb6d42c1f262c888564dd8229c5c99c1f2eabbe700aa92ab9e6ce4c7b5f81d29eb9aada1', 'id': 'a93bc8cd-331a-497d-9575-c81df5307289', 'created_at': datetime.datetime(2026, 7, 17, 5, 16, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 16, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a93bc8cd-331a-497d-9575-c81df5307289/file', 'properties': {}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b415a763-3be7-4e3a-ac1c-6553c1d90da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Volume volume-2385f26c-71b5-488b-a9c6-337e3a652670 (2385f26c-71b5-488b-a9c6-337e3a652670): created successfully Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b415a763-3be7-4e3a-ac1c-6553c1d90da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Flow 'volume_create_manager' (e6526511-effb-4f40-8dd7-c6c2360191ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a7e13ac1-280f-4912-9d2a-aa84c807fa5e tempest-VolumeImageDependencyTests-213972677 None] Created volume successfully. Jul 17 07:16:44 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 1073741824" returned: 0 in 0.469s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Acquiring lock "cinder-2385f26c-71b5-488b-a9c6-337e3a652670-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:44 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Lock "cinder-2385f26c-71b5-488b-a9c6-337e3a652670-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:44 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Acquiring lock "cinder-quobyte-2385f26c-71b5-488b-a9c6-337e3a652670" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Lock "cinder-quobyte-2385f26c-71b5-488b-a9c6-337e3a652670" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb57ce2a-7089-4446-ac5b-73ed627229eb]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:44 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 Jul 17 07:16:44 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:44 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75" returned: 0 in 0.278s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a15c57-ff7d-4eab-b8af-13751eaa7605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b120e174-aebe-4824-ba7d-406eff209c75', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac74f83-b736-4d7e-a656-f62613f9e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Volume volume-b120e174-aebe-4824-ba7d-406eff209c75 (b120e174-aebe-4824-ba7d-406eff209c75): created successfully Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac74f83-b736-4d7e-a656-f62613f9e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (e16b5210-228b-4453-8328-2d0c8dee69d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-44240452-d39e-40a8-bf7c-6a5813eb5d97 tempest-ProjectReaderTests-2032111384 None] Created volume successfully. Jul 17 07:16:44 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670" returned: 0 in 0.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:44 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670 Jul 17 07:16:44 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:45 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Flow 'volume_create_manager' (efcaa9b1-2fce-4b5c-8769-2adaa00b7e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9e1723-9665-4093-b0ac-95895088ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2385f26c-71b5-488b-a9c6-337e3a652670" returned: 0 in 0.296s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9e1723-9665-4093-b0ac-95895088ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a66f2c-251e-48f0-af4f-bc5d82252486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4104441149ba4d1fb5e54326bc30031f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f34a7369-b54d-4af7-8b97-24f11cca928b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:45Z,use_quota=True,user_id='75f7854a03504106abce2bdf62af4bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64470dad-3667-4d6b-9c88-84dbbe2d61eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64470dad-3667-4d6b-9c88-84dbbe2d61eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b72786-5fce-4d2e-8e29-d9783a1c26b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b72786-5fce-4d2e-8e29-d9783a1c26b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '99a66f2c-251e-48f0-af4f-bc5d82252486', 'volume_name': 'volume-99a66f2c-251e-48f0-af4f-bc5d82252486', 'volume_size': 1, 'snapshot_id': 'f34a7369-b54d-4af7-8b97-24f11cca928b'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d48aed-2fe2-4f00-a6c7-35ef024c43e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d48aed-2fe2-4f00-a6c7-35ef024c43e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe7fdf4-8af5-4531-8e6e-4cf209c8cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Volume 99a66f2c-251e-48f0-af4f-bc5d82252486: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-99a66f2c-251e-48f0-af4f-bc5d82252486', 'volume_size': 1, 'snapshot_id': 'f34a7369-b54d-4af7-8b97-24f11cca928b'} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Lock "cinder-quobyte-2385f26c-71b5-488b-a9c6-337e3a652670" released by "delete_volume" :: held 0.769s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-quobyte-f34a7369-b54d-4af7-8b97-24f11cca928b-99a66f2c-251e-48f0-af4f-bc5d82252486" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-f34a7369-b54d-4af7-8b97-24f11cca928b-99a66f2c-251e-48f0-af4f-bc5d82252486" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Creating volume 99a66f2c-251e-48f0-af4f-bc5d82252486 from snapshot f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-quobyte-99a66f2c-251e-48f0-af4f-bc5d82252486" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-99a66f2c-251e-48f0-af4f-bc5d82252486" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] snapshot: f34a7369-b54d-4af7-8b97-24f11cca928b, volume: 99a66f2c-251e-48f0-af4f-bc5d82252486, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Created reservations ['b2dcdecc-597f-42f0-bb12-23fb50da13f7', 'c9baca51-3ad1-4d80-b7a4-2b316278b0b5', '10ea1274-a56b-486d-b39e-35a38e1e920e', '74eceb14-97c4-4e40-b4a2-c67bf2045e8d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e4d8c-10a6-4701-874c-15e398ce4be2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:45 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:45 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:45 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b Jul 17 07:16:45 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:45 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.288s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Deleted volume successfully. Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d2b20ac9-94ed-489b-bab9-016c0453c614 tempest-VolumeImageDependencyTests-213972677 None] Lock "cinder-2385f26c-71b5-488b-a9c6-337e3a652670-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:45 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b" returned: 0 in 0.483s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8036511d-32c5-44e8-a07c-2e9300012560]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-b120e174-aebe-4824-ba7d-406eff209c75-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-b120e174-aebe-4824-ba7d-406eff209c75-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-quobyte-b120e174-aebe-4824-ba7d-406eff209c75" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-b120e174-aebe-4824-ba7d-406eff209c75" acquired by "delete_volume" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:45 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:45 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc73d8a-f928-4060-b639-20bccd51f0d1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:46 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 Jul 17 07:16:46 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:46 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.406s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:46 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 Jul 17 07:16:46 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:46 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75" returned: 0 in 0.426s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:46 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75 Jul 17 07:16:46 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:46 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b120e174-aebe-4824-ba7d-406eff209c75" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-b120e174-aebe-4824-ba7d-406eff209c75" released by "delete_volume" :: held 0.816s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:46 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Created reservations ['0c4acac7-a996-407a-8cb3-b24620c07718', 'c82aca9f-52d6-49d1-a6e8-d3cb1ec464d6', '6f087212-cd7f-4848-84ac-f2f0334d30e0', 'd09a05a3-bd13-4eb1-97b1-7c229600215a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:47 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:47 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:47 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.431s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Deleted volume successfully. Jul 17 07:16:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc8b630a-b87c-40f5-aeef-b6227a0dc2e5 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-b120e174-aebe-4824-ba7d-406eff209c75-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (a07002c5-9a53-44b3-8c23-28464fa61553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7b2b1e-8782-4d02-ab0e-775b0231c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7b2b1e-8782-4d02-ab0e-775b0231c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528165299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4687e18-35a5-4082-93e9-9119967f65bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:49Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dac7a8c-dd25-4a11-97fa-ca2d02891f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dac7a8c-dd25-4a11-97fa-ca2d02891f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de594c67-f852-43e8-96e8-06ea38b87e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de594c67-f852-43e8-96e8-06ea38b87e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4687e18-35a5-4082-93e9-9119967f65bd', 'volume_name': 'volume-e4687e18-35a5-4082-93e9-9119967f65bd', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0846f159-2cc2-4d2f-8609-5d5f195abc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0846f159-2cc2-4d2f-8609-5d5f195abc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a1cb63-0bea-4afb-92f3-608c7031c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:49 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Volume e4687e18-35a5-4082-93e9-9119967f65bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4687e18-35a5-4082-93e9-9119967f65bd', 'volume_size': 1} Jul 17 07:16:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:51 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486" returned: 0 in 5.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ea94c-281d-4b66-8b5a-785b53513e1e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:51 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:51 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:52 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.574s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:16:52 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Converted 1024.00 MB image at 192.64 MB/s Jul 17 07:16:52 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 is being set with open permissions: ugo+rw Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:52 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 Jul 17 07:16:52 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:52 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Flow 'volume_create_manager' (37240687-49d4-4110-8428-7115685d9ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934454e3-daf8-40cf-aa0d-bad054a55d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486" returned: 0 in 0.302s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934454e3-daf8-40cf-aa0d-bad054a55d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1280757161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bb323d-8364-4beb-8a75-7aaeb4324274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8909dbd541c457eb3ed9382097ec2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:52Z,use_quota=True,user_id='42e05a3a4ce3473f923f373d1de33b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461b045d-5208-4a72-923c-4f482d6a61e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461b045d-5208-4a72-923c-4f482d6a61e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f552a8-5024-4756-b547-7de2733cdcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f552a8-5024-4756-b547-7de2733cdcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50bb323d-8364-4beb-8a75-7aaeb4324274', 'volume_name': 'volume-50bb323d-8364-4beb-8a75-7aaeb4324274', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52692561-b6bc-45f9-8f86-b6b2f9b6a864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52692561-b6bc-45f9-8f86-b6b2f9b6a864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e6426a-fa79-4f38-a788-70e2abcf37df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:52 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Volume 50bb323d-8364-4beb-8a75-7aaeb4324274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50bb323d-8364-4beb-8a75-7aaeb4324274', 'volume_size': 1} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-99a66f2c-251e-48f0-af4f-bc5d82252486" released by "_copy_volume_from_snapshot" :: held 7.227s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-f34a7369-b54d-4af7-8b97-24f11cca928b-99a66f2c-251e-48f0-af4f-bc5d82252486" released by "_create_volume_from_snapshot" :: held 7.260s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.279s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.883s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528165299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4687e18-35a5-4082-93e9-9119967f65bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e53f85fafb74e5bb7445ef7f4c1cb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:49Z,use_quota=True,user_id='936e0b7edb4d4b539265be066a9d79b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Creating volume e4687e18-35a5-4082-93e9-9119967f65bd {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:52 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:52 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd 1073741824 Jul 17 07:16:52 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe7fdf4-8af5-4531-8e6e-4cf209c8cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a66f2c-251e-48f0-af4f-bc5d82252486', 'volume_size': 1, 'snapshot_id': 'f34a7369-b54d-4af7-8b97-24f11cca928b'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437a35a9-8ad2-47df-988b-19e39e3acc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:52 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Volume volume-99a66f2c-251e-48f0-af4f-bc5d82252486 (99a66f2c-251e-48f0-af4f-bc5d82252486): created successfully Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437a35a9-8ad2-47df-988b-19e39e3acc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Flow 'volume_create_manager' (efcaa9b1-2fce-4b5c-8769-2adaa00b7e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6a89eeb7-a5a3-43a2-ac76-01fda8842bdd tempest-SnapshotDependencyTests-1517301488 None] Created volume successfully. Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-f34a7369-b54d-4af7-8b97-24f11cca928b-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:52 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd 1073741824" returned: 0 in 0.449s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-f34a7369-b54d-4af7-8b97-24f11cca928b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-quobyte-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-quobyte-f34a7369-b54d-4af7-8b97-24f11cca928b" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-f34a7369-b54d-4af7-8b97-24f11cca928b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Deleting offline snapshot f34a7369-b54d-4af7-8b97-24f11cca928b of volume ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:16:53 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd Jul 17 07:16:53 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] snapshot_file for this snap is: volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[862d608f-d4eb-41b3-8fbf-a6e65d4ce270]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b Jul 17 07:16:53 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:53 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1280757161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bb323d-8364-4beb-8a75-7aaeb4324274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8909dbd541c457eb3ed9382097ec2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:52Z,use_quota=True,user_id='42e05a3a4ce3473f923f373d1de33b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Creating volume 50bb323d-8364-4beb-8a75-7aaeb4324274 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:53 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a1cb63-0bea-4afb-92f3-608c7031c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4687e18-35a5-4082-93e9-9119967f65bd', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:53 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 1073741824 Jul 17 07:16:53 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40de4d2-4ba7-4d2a-b3b0-a451b57e5975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:53 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Volume volume-e4687e18-35a5-4082-93e9-9119967f65bd (e4687e18-35a5-4082-93e9-9119967f65bd): created successfully Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40de4d2-4ba7-4d2a-b3b0-a451b57e5975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Flow 'volume_create_manager' (a07002c5-9a53-44b3-8c23-28464fa61553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-823d9a3b-45f6-437a-8f88-494d2dddd547 tempest-ProjectReaderTests-2032111384 None] Created volume successfully. Jul 17 07:16:53 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b" returned: 0 in 0.373s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2f53cb-2fe5-4832-a413-b92cb58f4e2b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:53 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-e4687e18-35a5-4082-93e9-9119967f65bd-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-e4687e18-35a5-4082-93e9-9119967f65bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "cinder-quobyte-e4687e18-35a5-4082-93e9-9119967f65bd" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-e4687e18-35a5-4082-93e9-9119967f65bd" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d6b12e-2488-4969-82a2-7eb337643b57]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 1073741824" returned: 0 in 0.527s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 Jul 17 07:16:53 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:53 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd Jul 17 07:16:53 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:53 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:53 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b Jul 17 07:16:53 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:54 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e6426a-fa79-4f38-a788-70e2abcf37df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50bb323d-8364-4beb-8a75-7aaeb4324274', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a783a952-ace3-47fb-a95d-bd9ec4ac4352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:54 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:54 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Volume volume-50bb323d-8364-4beb-8a75-7aaeb4324274 (50bb323d-8364-4beb-8a75-7aaeb4324274): created successfully Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a783a952-ace3-47fb-a95d-bd9ec4ac4352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:54 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd Jul 17 07:16:54 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Flow 'volume_create_manager' (37240687-49d4-4110-8428-7115685d9ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8c706b97-47b1-4fa6-99f9-f47f719cdcbb tempest-ProjectReaderTests-796365628 None] Created volume successfully. Jul 17 07:16:54 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b" returned: 0 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:54 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b Jul 17 07:16:54 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:54 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e4687e18-35a5-4082-93e9-9119967f65bd" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-quobyte-e4687e18-35a5-4082-93e9-9119967f65bd" released by "delete_volume" :: held 0.709s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Created reservations ['86f95d6b-cd30-4c0b-b85d-6c526a82d370', 'c61d62cb-8e27-4dec-8a66-fea8afb40969', 'fe3b2f99-80f5-4d82-a16f-7d50e42bef82', 'fa0e5b31-6783-4bc5-8a6e-5a74c3726954'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:54 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248.f34a7369-b54d-4af7-8b97-24f11cca928b" returned: 0 in 0.272s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:54 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:54 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-f34a7369-b54d-4af7-8b97-24f11cca928b" released by "_delete_snapshot" :: held 1.591s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" released by "delete_snapshot" :: held 1.635s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Acquiring lock "cinder-50bb323d-8364-4beb-8a75-7aaeb4324274-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Lock "cinder-50bb323d-8364-4beb-8a75-7aaeb4324274-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Acquiring lock "cinder-quobyte-50bb323d-8364-4beb-8a75-7aaeb4324274" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Created reservations ['993e122f-b2ef-4182-903d-fe0973b565b1', 'a8506e3b-f067-4bee-b6ad-ff85f6307161', 'ff4dde34-0c92-4108-b25b-127f2990e0c9', 'f4ee4f10-6c2b-4fb1-a627-8a0adee4a656'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Lock "cinder-quobyte-50bb323d-8364-4beb-8a75-7aaeb4324274" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[93647537-f9af-4f88-b90c-0db0851ee76d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Delete snapshot completed successfully. Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-af313dd1-25c5-4437-a9e6-4fdad9391b80 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-f34a7369-b54d-4af7-8b97-24f11cca928b-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:54 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Deleted volume successfully. Jul 17 07:16:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6a11942e-b85b-49b5-b6d7-2cd01b78e054 tempest-ProjectReaderTests-2032111384 None] Lock "cinder-e4687e18-35a5-4082-93e9-9119967f65bd-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:54 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 Jul 17 07:16:54 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-ea82f6dd-e3fc-48ac-8abd-54e1606d2248-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-ea82f6dd-e3fc-48ac-8abd-54e1606d2248-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-quobyte-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:55 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c6fbf-c3a9-4c9a-a3a3-32c8d0d35692]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:55 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274 Jul 17 07:16:55 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:55 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:55 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:55 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50bb323d-8364-4beb-8a75-7aaeb4324274" returned: 0 in 0.264s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Lock "cinder-quobyte-50bb323d-8364-4beb-8a75-7aaeb4324274" released by "delete_volume" :: held 0.798s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Created reservations ['0dfe8238-dea8-46c9-a937-1379b41bffd2', '2079a104-af69-4297-949d-aa6beb947335', '43986510-2aa8-4ff8-b7c3-0d36949b58a3', 'ec18e9b6-ef3d-491f-9719-685470742c5b'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:55 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:55 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:55 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:55 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248 Jul 17 07:16:55 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:56 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" returned: 0 in 0.333s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:56 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.373s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-ea82f6dd-e3fc-48ac-8abd-54e1606d2248" released by "delete_volume" :: held 0.841s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Deleted volume successfully. Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bd834da1-5e19-4d76-913b-6918a0eb6c47 tempest-ProjectReaderTests-796365628 None] Lock "cinder-50bb323d-8364-4beb-8a75-7aaeb4324274-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Created reservations ['6683f33e-15cc-4d47-acf9-33c1842c1f7f', '7e1c29e9-be1f-47e1-a9f2-b75c96d5d97b', '1771a6bc-10fe-470d-9fd1-6047a979bc8f', '90ed9a43-a35f-4889-95ae-28200fa526fa'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:56 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:56 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-99a66f2c-251e-48f0-af4f-bc5d82252486-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-99a66f2c-251e-48f0-af4f-bc5d82252486-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "cinder-quobyte-99a66f2c-251e-48f0-af4f-bc5d82252486" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-99a66f2c-251e-48f0-af4f-bc5d82252486" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:16:56 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Flow 'volume_create_manager' (f031f97c-bc6b-4d71-8a41-2cd74d816feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b3122-9674-4c1d-a6a1-48177024a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a25998-add4-4138-b1ed-4fe30ee1524e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b3122-9674-4c1d-a6a1-48177024a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917369533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edb3b40-3398-4144-bef5-616b635c8926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8909dbd541c457eb3ed9382097ec2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:56Z,use_quota=True,user_id='42e05a3a4ce3473f923f373d1de33b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b602d2dd-cf31-4ec1-8eea-df5f5c43f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b602d2dd-cf31-4ec1-8eea-df5f5c43f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0377f72d-643d-4f6c-a6a3-f1fd8bd1d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0377f72d-643d-4f6c-a6a3-f1fd8bd1d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edb3b40-3398-4144-bef5-616b635c8926', 'volume_name': 'volume-5edb3b40-3398-4144-bef5-616b635c8926', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e92db22-3bf6-4acd-8ac7-d8806e4afad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e92db22-3bf6-4acd-8ac7-d8806e4afad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0bedf9-877f-4ffb-8d90-19dce5159b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:56 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Volume 5edb3b40-3398-4144-bef5-616b635c8926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edb3b40-3398-4144-bef5-616b635c8926', 'volume_size': 1} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917369533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edb3b40-3398-4144-bef5-616b635c8926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8909dbd541c457eb3ed9382097ec2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:16:56Z,use_quota=True,user_id='42e05a3a4ce3473f923f373d1de33b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Creating volume 5edb3b40-3398-4144-bef5-616b635c8926 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:16:56 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Deleted volume successfully. Jul 17 07:16:56 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 Jul 17 07:16:56 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-0b58b893-b180-4134-be93-0f2346c9927b tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-ea82f6dd-e3fc-48ac-8abd-54e1606d2248-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:56 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 1073741824 Jul 17 07:16:56 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:57 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486" returned: 0 in 0.410s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:57 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486 Jul 17 07:16:57 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:57 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 1073741824" returned: 0 in 0.468s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:57 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 Jul 17 07:16:57 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:57 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-99a66f2c-251e-48f0-af4f-bc5d82252486" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-quobyte-99a66f2c-251e-48f0-af4f-bc5d82252486" released by "delete_volume" :: held 0.781s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Created reservations ['20ca98f0-009e-4318-9977-2ab25ec52625', 'f02679ed-8870-45fc-b7df-4a0c52a8985e', '0c374d5b-4535-4fc8-92fc-716e2431885d', '119ac3a9-a6e5-4c55-bc6f-787292c91a52'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:57 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926" returned: 0 in 0.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0bedf9-877f-4ffb-8d90-19dce5159b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edb3b40-3398-4144-bef5-616b635c8926', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:57 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:57 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f36df0-f6a3-4d55-88c4-79555c468a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:16:57 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Volume volume-5edb3b40-3398-4144-bef5-616b635c8926 (5edb3b40-3398-4144-bef5-616b635c8926): created successfully Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f36df0-f6a3-4d55-88c4-79555c468a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Flow 'volume_create_manager' (f031f97c-bc6b-4d71-8a41-2cd74d816feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:16:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6d4fff4f-8a8b-4e42-973f-2be532727f62 tempest-ProjectReaderTests-796365628 None] Created volume successfully. Jul 17 07:16:57 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.264s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Deleted volume successfully. Jul 17 07:16:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83b7e5d1-cd95-4c64-8010-a187261363f7 tempest-SnapshotDependencyTests-1517301488 None] Lock "cinder-99a66f2c-251e-48f0-af4f-bc5d82252486-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Acquiring lock "cinder-5edb3b40-3398-4144-bef5-616b635c8926-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Lock "cinder-5edb3b40-3398-4144-bef5-616b635c8926-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=212,cinder:SELECT=170,cinder:INSERT=58,cinder:DELETE=18 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Acquiring lock "cinder-quobyte-5edb3b40-3398-4144-bef5-616b635c8926" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Lock "cinder-quobyte-5edb3b40-3398-4144-bef5-616b635c8926" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fe6c2-205f-4e33-8a8f-b2969087bc20]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:16:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:58 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 Jul 17 07:16:58 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:59 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926" returned: 0 in 0.397s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:59 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926 Jul 17 07:16:59 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:59 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5edb3b40-3398-4144-bef5-616b635c8926" returned: 0 in 0.248s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Lock "cinder-quobyte-5edb3b40-3398-4144-bef5-616b635c8926" released by "delete_volume" :: held 0.688s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Created reservations ['6fe6fda4-0c88-4180-a827-5216bbd5df0c', '81fddfaa-f7cb-4b17-853e-7325da67b8ac', '36495464-732f-42b4-9c38-4713f56d865e', '3ebcef79-bb90-4323-854d-0f69e84618d1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:16:59 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:16:59 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:16:59 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:16:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Deleted volume successfully. Jul 17 07:16:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-736da49c-4c9a-42f0-9d67-5dc225344ca1 tempest-ProjectReaderTests-796365628 None] Lock "cinder-5edb3b40-3398-4144-bef5-616b635c8926-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:09 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=88,cinder:SELECT=57,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:17:09 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (ccf4c41b-8e34-4286-9a0a-59ba71b2e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e91fe91-2f33-44bf-8110-f2d8d186014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Flow 'volume_create_manager' (daf2d7ab-67d1-4be9-ac32-05caa5a23ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383bc6bc-c854-44b5-b86b-b5103ef23053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e91fe91-2f33-44bf-8110-f2d8d186014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191259445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9953e522-deb7-48f8-9eb6-59b425e8e3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:16Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f89196b-ab5e-4204-9eb7-b2e4b7891b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f89196b-ab5e-4204-9eb7-b2e4b7891b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0633d9-f871-485f-93b3-8af9cec122f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0633d9-f871-485f-93b3-8af9cec122f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9953e522-deb7-48f8-9eb6-59b425e8e3b3', 'volume_name': 'volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039c290-2ca1-4aed-b599-dcd8aa816ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039c290-2ca1-4aed-b599-dcd8aa816ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a821eb3-bbd9-4584-b3f5-0414d0ac22ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Volume 9953e522-deb7-48f8-9eb6-59b425e8e3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3', 'volume_size': 1} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191259445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9953e522-deb7-48f8-9eb6-59b425e8e3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:16Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Creating volume 9953e522-deb7-48f8-9eb6-59b425e8e3b3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:16 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383bc6bc-c854-44b5-b86b-b5103ef23053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-627130170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61f3911-54f1-4890-a0d8-258258134971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe8c20438340dab1a7d4cf4caa8e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:16Z,use_quota=True,user_id='6aabcd61d2b5482e85d55294f1122adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 1073741824 Jul 17 07:17:16 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e455c3f4-c9a6-482e-9d7f-a45fa87c8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e455c3f4-c9a6-482e-9d7f-a45fa87c8bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be412e4-2ebf-4197-b897-4d869641c2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be412e4-2ebf-4197-b897-4d869641c2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b61f3911-54f1-4890-a0d8-258258134971', 'volume_name': 'volume-b61f3911-54f1-4890-a0d8-258258134971', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a03376-4620-4cca-92b3-5e234ffdfea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a03376-4620-4cca-92b3-5e234ffdfea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de11339-0abd-45bf-99c7-c3d8cfd5f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Volume b61f3911-54f1-4890-a0d8-258258134971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b61f3911-54f1-4890-a0d8-258258134971', 'volume_size': 1} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (00cedf65-5592-4b7e-8dee-c5f53e680309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd4553e-3000-44d4-a219-bf76dbb191a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd4553e-3000-44d4-a219-bf76dbb191a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012021608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f2bdae-3b85-4b22-9566-83d01c0ef2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:17Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef73fdce-3919-49f8-9e4c-a245136293eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef73fdce-3919-49f8-9e4c-a245136293eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5878a4-6287-4687-a22a-5546445dd318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5878a4-6287-4687-a22a-5546445dd318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f2bdae-3b85-4b22-9566-83d01c0ef2b4', 'volume_name': 'volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4960595b-9fa6-42e7-a108-60246d29d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4960595b-9fa6-42e7-a108-60246d29d06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef93c9b-1956-4409-8307-823cbc73560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:16 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Volume e1f2bdae-3b85-4b22-9566-83d01c0ef2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4', 'volume_size': 1} Jul 17 07:17:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (4521fe79-1620-4c91-8a14-5e2b2cbd1ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:17 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2256065a-d351-4d3d-addd-985db9263421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 1073741824" returned: 0 in 0.649s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2256065a-d351-4d3d-addd-985db9263421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637864350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb97c9bb-de36-4a60-98c2-46e65bf89c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:17Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca89380-39ac-491a-8fa8-c187ce10d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca89380-39ac-491a-8fa8-c187ce10d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07453567-8325-4431-98fa-fe49f74b5b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07453567-8325-4431-98fa-fe49f74b5b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb97c9bb-de36-4a60-98c2-46e65bf89c16', 'volume_name': 'volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5b56a3-7299-4f49-a9cd-9d591d9d7f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5b56a3-7299-4f49-a9cd-9d591d9d7f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d31f07-fd1c-49de-9da1-1b4d6862663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Volume bb97c9bb-de36-4a60-98c2-46e65bf89c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16', 'volume_size': 1} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:17 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 Jul 17 07:17:17 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (44e0f219-ca2b-47f1-9804-bb63d3b23955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ce2306-40c7-4c72-83c1-a2cabf01df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ce2306-40c7-4c72-83c1-a2cabf01df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766779280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50138c1-c8ea-4132-a821-5580bea39903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:18Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cb93a6-5dc4-4496-a5c4-9e938bd44c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cb93a6-5dc4-4496-a5c4-9e938bd44c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0fc94c-9e9c-4446-9389-2eeec49fb900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0fc94c-9e9c-4446-9389-2eeec49fb900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50138c1-c8ea-4132-a821-5580bea39903', 'volume_name': 'volume-e50138c1-c8ea-4132-a821-5580bea39903', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80391065-bc41-481a-b108-ac2a6ae0dabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80391065-bc41-481a-b108-ac2a6ae0dabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0586325b-df05-44fd-9e5d-8924b2937fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Volume e50138c1-c8ea-4132-a821-5580bea39903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50138c1-c8ea-4132-a821-5580bea39903', 'volume_size': 1} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3" returned: 0 in 0.406s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-627130170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b61f3911-54f1-4890-a0d8-258258134971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe8c20438340dab1a7d4cf4caa8e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:16Z,use_quota=True,user_id='6aabcd61d2b5482e85d55294f1122adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Creating volume b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:17 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:18 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 1073741824 Jul 17 07:17:18 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a821eb3-bbd9-4584-b3f5-0414d0ac22ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51dfecf-61fb-47e6-af01-bc7626e8c43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Volume volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 (9953e522-deb7-48f8-9eb6-59b425e8e3b3): created successfully Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51dfecf-61fb-47e6-af01-bc7626e8c43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (ccf4c41b-8e34-4286-9a0a-59ba71b2e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-32569e1f-ad07-440d-89f7-ab7ca23d15d9 tempest-CreateVolumesFromImageTest-919214476 None] Created volume successfully. Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (2a6e0537-70ca-43a1-90ca-6757426a7a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6da5fa-ede0-45e0-9cec-65609a27e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6da5fa-ede0-45e0-9cec-65609a27e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2071017879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc3fdb1-dca9-448d-b113-1b34b604e9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:18Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f0f48b-7bf5-4a3b-b01b-2847338d1f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f0f48b-7bf5-4a3b-b01b-2847338d1f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313188d4-c9c4-4074-9728-53a23be68547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313188d4-c9c4-4074-9728-53a23be68547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc3fdb1-dca9-448d-b113-1b34b604e9d3', 'volume_name': 'volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dd9ede-83c9-4b00-a6b5-68aec6e427fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dd9ede-83c9-4b00-a6b5-68aec6e427fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acdb8b9-0c44-4b46-9302-7fdb663e49b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Volume 2fc3fdb1-dca9-448d-b113-1b34b604e9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3', 'volume_size': 1} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:18 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 1073741824" returned: 0 in 0.568s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:18 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:18 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:18 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012021608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f2bdae-3b85-4b22-9566-83d01c0ef2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:17Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Creating volume e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:18 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de11339-0abd-45bf-99c7-c3d8cfd5f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b61f3911-54f1-4890-a0d8-258258134971', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 1073741824 Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3019411-9af1-4ff6-bd66-e44c7ce71b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:18 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Volume volume-b61f3911-54f1-4890-a0d8-258258134971 (b61f3911-54f1-4890-a0d8-258258134971): created successfully Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3019411-9af1-4ff6-bd66-e44c7ce71b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Flow 'volume_create_manager' (daf2d7ab-67d1-4be9-ac32-05caa5a23ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8eb2bca9-db90-413b-abad-15b9d4897e57 tempest-VolumeDependencyTests-934523925 None] Created volume successfully. Jul 17 07:17:19 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 1073741824" returned: 0 in 0.545s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:19 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 Jul 17 07:17:19 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:19 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4" returned: 0 in 0.347s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637864350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb97c9bb-de36-4a60-98c2-46e65bf89c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:17Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Creating volume bb97c9bb-de36-4a60-98c2-46e65bf89c16 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:19 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:19 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 1073741824 Jul 17 07:17:19 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef93c9b-1956-4409-8307-823cbc73560f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cfa27b-9cb9-4123-918c-ad25a9fa48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:19 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Volume volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 (e1f2bdae-3b85-4b22-9566-83d01c0ef2b4): created successfully Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cfa27b-9cb9-4123-918c-ad25a9fa48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:19 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (00cedf65-5592-4b7e-8dee-c5f53e680309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8c3cef90-b958-439f-a609-271c0cde63c7 tempest-CreateVolumesFromImageTest-919214476 None] Created volume successfully. Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Flow 'volume_create_manager' (2a567b6c-6e36-44f2-83ca-f2d4322c0d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22ab4b8-d891-4f73-85bf-03da34996915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22ab4b8-d891-4f73-85bf-03da34996915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a667367-8157-4fc2-91ba-4eef00b08f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7581d7df3c4af7b873e02643718cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:20Z,use_quota=True,user_id='9be651a6875040a78a325b310aa43f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74547b74-2731-449a-a9ec-709bef0ea734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74547b74-2731-449a-a9ec-709bef0ea734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58a4b06-85f2-471a-86de-c41614417f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:17:20 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 1073741824" returned: 0 in 0.510s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58a4b06-85f2-471a-86de-c41614417f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a667367-8157-4fc2-91ba-4eef00b08f17', 'volume_name': 'volume-4a667367-8157-4fc2-91ba-4eef00b08f17', 'volume_size': 1, 'image_id': '663499be-8210-498e-b13a-88acc42ee200', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/663499be-8210-498e-b13a-88acc42ee200', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ac0d47580a038c0900e275bf99597c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc7581d7df3c4af7b873e02643718cbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cde12bbb36f24cea89c3472d1c6f3c8f2bcc118b7a4a9d687c178fcd38d2d3524e80f142be2be3bf9fe2d899f3536cf9f6786fb256c590f4f764699a63d163ad', 'id': '663499be-8210-498e-b13a-88acc42ee200', 'created_at': datetime.datetime(2026, 7, 17, 5, 17, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 17, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/663499be-8210-498e-b13a-88acc42ee200/file', 'properties': {}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798ecd51-4014-4144-8b1d-00c1384690bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798ecd51-4014-4144-8b1d-00c1384690bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 Jul 17 07:17:20 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11c8742-7b24-497b-910d-a995cf7d8942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Volume 4a667367-8157-4fc2-91ba-4eef00b08f17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a667367-8157-4fc2-91ba-4eef00b08f17', 'volume_size': 1, 'image_id': '663499be-8210-498e-b13a-88acc42ee200', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/663499be-8210-498e-b13a-88acc42ee200', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ac0d47580a038c0900e275bf99597c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc7581d7df3c4af7b873e02643718cbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cde12bbb36f24cea89c3472d1c6f3c8f2bcc118b7a4a9d687c178fcd38d2d3524e80f142be2be3bf9fe2d899f3536cf9f6786fb256c590f4f764699a63d163ad', 'id': '663499be-8210-498e-b13a-88acc42ee200', 'created_at': datetime.datetime(2026, 7, 17, 5, 17, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 17, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/663499be-8210-498e-b13a-88acc42ee200/file', 'properties': {}}, 'image_service': } Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Trying to clone 4a667367-8157-4fc2-91ba-4eef00b08f17 from image 663499be-8210-498e-b13a-88acc42ee200 at location (None, [{'url': 'file:///opt/stack/data/glance/images/663499be-8210-498e-b13a-88acc42ee200', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:17:20 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Image download 0.00 MB at 0.00 MB/s Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Flow 'volume_create_manager' (c1f0dc68-2e2d-4063-a85d-ae41e56afdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95eb07a7-2278-402d-8952-07e450814e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95eb07a7-2278-402d-8952-07e450814e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e627b8df-c3a8-47b9-b5e4-af1441d4ce69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36472ae2366948a59937f2ce1ebe32d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:21Z,use_quota=True,user_id='87f97cd2e43b402d9dab86feeddd89d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1546e7a2-7d2c-409e-aa48-381f78c427d5),volume_type_id=1546e7a2-7d2c-409e-aa48-381f78c427d5)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0e229e-e02a-4cd5-9e42-dac53a0006e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0e229e-e02a-4cd5-9e42-dac53a0006e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db097ec0-0bc9-4713-a96a-15d14b31dc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.image.glance [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Creating Keystone auth plugin from conf {{(pid=87331) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c476777-71b5-48a0-ab9f-095dc9fdc15e]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:20 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16" returned: 0 in 0.272s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766779280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50138c1-c8ea-4132-a821-5580bea39903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:18Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Creating volume e50138c1-c8ea-4132-a821-5580bea39903 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:20 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:20 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 1073741824 Jul 17 07:17:20 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d31f07-fd1c-49de-9da1-1b4d6862663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3395b7a-c77f-4f03-8d12-61613b8eed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Volume volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 (bb97c9bb-de36-4a60-98c2-46e65bf89c16): created successfully Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3395b7a-c77f-4f03-8d12-61613b8eed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (4521fe79-1620-4c91-8a14-5e2b2cbd1ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:20 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD Jul 17 07:17:20 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3cad72c4-18af-425e-8297-8010ab72496f tempest-CreateVolumesFromImageTest-919214476 None] Created volume successfully. Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db097ec0-0bc9-4713-a96a-15d14b31dc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e627b8df-c3a8-47b9-b5e4-af1441d4ce69', 'volume_name': 'volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69', 'volume_size': 1, 'image_id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87217e6a4562ef694fe0a8daa96c6f2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '36472ae2366948a59937f2ce1ebe32d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d52fc73d15521fe013c8c02ab99fe77ac25aa614d51d20f94ad64da64d67bb1f91b24ec395c80fa19cb8dc2f18171c4665c8fbf76dddd2e54853a4167579295', 'id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'created_at': datetime.datetime(2026, 7, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 17, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051ce8c6-9dab-4747-8e79-6a840359243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051ce8c6-9dab-4747-8e79-6a840359243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6d23b5-985f-4edf-9ae4-62a788547a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:20 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Volume e627b8df-c3a8-47b9-b5e4-af1441d4ce69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69', 'volume_size': 1, 'image_id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87217e6a4562ef694fe0a8daa96c6f2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '36472ae2366948a59937f2ce1ebe32d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d52fc73d15521fe013c8c02ab99fe77ac25aa614d51d20f94ad64da64d67bb1f91b24ec395c80fa19cb8dc2f18171c4665c8fbf76dddd2e54853a4167579295', 'id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'created_at': datetime.datetime(2026, 7, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 17, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 17 07:17:20 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Trying to clone e627b8df-c3a8-47b9-b5e4-af1441d4ce69 from image 3837bc28-62b0-4fa1-80e6-e51e8108bd55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'metadata': {}}]). {{(pid=87331) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 17 07:17:21 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Image download 0.00 MB at 0.00 MB/s Jul 17 07:17:21 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1ef9c-2183-4dcc-82a6-933dd5102a84]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD Jul 17 07:17:21 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:21 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 1073741824" returned: 0 in 0.518s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD Jul 17 07:17:21 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 Jul 17 07:17:21 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:21 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Temporary image 663499be-8210-498e-b13a-88acc42ee200 is fetched for user 9be651a6875040a78a325b310aa43f6c. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:17:21 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cffd41-0848-4680-8aa2-01019d3de8dc]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.222s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2071017879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc3fdb1-dca9-448d-b113-1b34b604e9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d98bd9895e4d6b9bdda615e24a9a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:18Z,use_quota=True,user_id='9b8dc842b22e4e6bb22f775963cd0ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Creating volume 2fc3fdb1-dca9-448d-b113-1b34b604e9d3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:21 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 1073741824 Jul 17 07:17:21 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0586325b-df05-44fd-9e5d-8924b2937fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50138c1-c8ea-4132-a821-5580bea39903', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae6859a-d4fd-42c7-a28e-e17416f2352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:21 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD Jul 17 07:17:21 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:21 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Volume volume-e50138c1-c8ea-4132-a821-5580bea39903 (e50138c1-c8ea-4132-a821-5580bea39903): created successfully Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae6859a-d4fd-42c7-a28e-e17416f2352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (44e0f219-ca2b-47f1-9804-bb63d3b23955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-fc28676c-3db6-4d50-8365-67f1edd08292 tempest-CreateVolumesFromImageTest-919214476 None] Created volume successfully. Jul 17 07:17:21 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD Jul 17 07:17:21 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:21 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Temporary image 3837bc28-62b0-4fa1-80e6-e51e8108bd55 is fetched for user 87f97cd2e43b402d9dab86feeddd89d3. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 17 07:17:21 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a291fd2-1442-409b-b619-47dd51a43bbb]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:22 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 1073741824" returned: 0 in 0.483s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:22 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD Jul 17 07:17:22 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:22 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD Jul 17 07:17:22 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:22 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 Jul 17 07:17:22 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:22 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:22 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:22 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3" returned: 0 in 0.253s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.324s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Creating offline snapshot 8a49629f-1a24-4e2a-8e88-718b4c2dff18 of volume b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acdb8b9-0c44-4b46-9302-7fdb663e49b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8d00a1-021a-446b-84d1-619cc2f31393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e34ec-697c-4720-a20d-29446fff0e2d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:22 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Volume volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 (2fc3fdb1-dca9-448d-b113-1b34b604e9d3): created successfully Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8d00a1-021a-446b-84d1-619cc2f31393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Flow 'volume_create_manager' (2a6e0537-70ca-43a1-90ca-6757426a7a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:22 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD Jul 17 07:17:22 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f379e191-221d-4952-bcd9-ad3b015d44eb tempest-CreateVolumesFromImageTest-919214476 None] Created volume successfully. Jul 17 07:17:22 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:22 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:22 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-2fc3fdb1-dca9-448d-b113-1b34b604e9d3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-2fc3fdb1-dca9-448d-b113-1b34b604e9d3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-quobyte-2fc3fdb1-dca9-448d-b113-1b34b604e9d3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-2fc3fdb1-dca9-448d-b113-1b34b604e9d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:22 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2bcd76-04e7-4d2b-9bdf-1a3e773cdcce]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.430s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:22 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 1G Jul 17 07:17:22 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:22 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 Jul 17 07:17:22 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:23 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3" returned: 0 in 0.373s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:23 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3 Jul 17 07:17:23 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:23 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 1G" returned: 0 in 0.435s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b61f3911-54f1-4890-a0d8-258258134971 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:23 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b61f3911-54f1-4890-a0d8-258258134971 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 Jul 17 07:17:23 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:23 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-2fc3fdb1-dca9-448d-b113-1b34b604e9d3" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-2fc3fdb1-dca9-448d-b113-1b34b604e9d3" released by "delete_volume" :: held 0.673s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Created reservations ['50068d9a-2145-41f4-affa-b0217475cd0d', '037084b8-d350-4e0f-9aba-4846e252aa2c', 'ddfcb837-8d59-4432-8533-4b7dea956ceb', 'c4f73289-ec13-4efe-a800-1260ec46599f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:23 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b61f3911-54f1-4890-a0d8-258258134971 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18" returned: 0 in 0.303s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:23 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 is being set with open permissions: ugo+rw Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:23 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 Jul 17 07:17:23 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:23 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:23 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:23 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18" returned: 0 in 0.243s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:23 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.264s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-e50138c1-c8ea-4132-a821-5580bea39903-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:23 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info Jul 17 07:17:23 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Deleted volume successfully. Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-e50138c1-c8ea-4132-a821-5580bea39903-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df64dee2-258a-4d93-a6ea-7d609a33b600 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-2fc3fdb1-dca9-448d-b113-1b34b604e9d3-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-quobyte-e50138c1-c8ea-4132-a821-5580bea39903" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-e50138c1-c8ea-4132-a821-5580bea39903" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c874602-62d7-4c81-b9a6-6615258cf0ae]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:24 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 Jul 17 07:17:24 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:24 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info" returned: 0 in 0.278s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:24 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info is being set with open permissions: ugo+rw Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:24 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info Jul 17 07:17:24 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:24 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903" returned: 0 in 0.373s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:24 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.info" returned: 0 in 0.249s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:24 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903 Jul 17 07:17:24 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a667367-8157-4fc2-91ba-4eef00b08f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7581d7df3c4af7b873e02643718cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:20Z,use_quota=True,user_id='9be651a6875040a78a325b310aa43f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Creating volume 4a667367-8157-4fc2-91ba-4eef00b08f17 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:24 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:24 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 1073741824 Jul 17 07:17:24 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:24 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-505b5c85-1b31-4f8f-8f09-aa46ce40911c tempest-VolumeDependencyTests-934523925 None] Create snapshot completed successfully Jul 17 07:17:24 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e50138c1-c8ea-4132-a821-5580bea39903" returned: 0 in 0.244s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-e50138c1-c8ea-4132-a821-5580bea39903" released by "delete_volume" :: held 0.656s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Created reservations ['793889ec-66b5-41da-b7b4-da2fb61eb266', 'd5312324-e8ee-4eac-b1f2-7e13224d7b52', '4174b5ce-a783-41a3-88a6-15715095aed4', '9f943db5-a3c2-4799-94e2-49881ba2b4c0'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:24 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:24 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:24 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 1073741824" returned: 0 in 0.463s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:24 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 Jul 17 07:17:24 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.289s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Deleted volume successfully. Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-bb97c9bb-de36-4a60-98c2-46e65bf89c16-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-41bbb49b-d3b6-4a0b-81f0-2004b7dd03b7 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-e50138c1-c8ea-4132-a821-5580bea39903-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-bb97c9bb-de36-4a60-98c2-46e65bf89c16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-quobyte-bb97c9bb-de36-4a60-98c2-46e65bf89c16" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-bb97c9bb-de36-4a60-98c2-46e65bf89c16" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:25 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7bca5-fdc1-4bed-b28e-787f509fc013]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.520s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e627b8df-c3a8-47b9-b5e4-af1441d4ce69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36472ae2366948a59937f2ce1ebe32d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:21Z,use_quota=True,user_id='87f97cd2e43b402d9dab86feeddd89d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1546e7a2-7d2c-409e-aa48-381f78c427d5),volume_type_id=1546e7a2-7d2c-409e-aa48-381f78c427d5)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Creating volume e627b8df-c3a8-47b9-b5e4-af1441d4ce69 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:25 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:25 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 1073741824 Jul 17 07:17:25 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Attempting download of 663499be-8210-498e-b13a-88acc42ee200 ((None, [{'url': 'file:///opt/stack/data/glance/images/663499be-8210-498e-b13a-88acc42ee200', 'metadata': {}}])) to volume 4a667367-8157-4fc2-91ba-4eef00b08f17. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee34974-2934-437c-963e-f14416ba1467]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:25 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 Jul 17 07:17:25 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4 Jul 17 07:17:25 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16" returned: 0 in 0.489s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:25 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4" returned: 0 in 0.413s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:25 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16 Jul 17 07:17:25 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 1073741824" returned: 0 in 0.634s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:25 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4 Jul 17 07:17:25 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 Jul 17 07:17:25 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Flow 'volume_create_manager' (bd1ac8f5-efa4-45ce-9256-c71dce273e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c66300-7c19-4260-bb0a-2be4bacff2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c66300-7c19-4260-bb0a-2be4bacff2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1143264097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fe8c20438340dab1a7d4cf4caa8e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a49629f-1a24-4e2a-8e88-718b4c2dff18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:26Z,use_quota=True,user_id='6aabcd61d2b5482e85d55294f1122adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce52fcf-90ae-4dc2-8648-fd795c4d8b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:25 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce52fcf-90ae-4dc2-8648-fd795c4d8b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:25 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336a3805-e92e-4751-b148-0d793063be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336a3805-e92e-4751-b148-0d793063be6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f', 'volume_name': 'volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f', 'volume_size': 1, 'snapshot_id': '8a49629f-1a24-4e2a-8e88-718b4c2dff18'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b582671-2c2c-4f6e-9648-4cefd2b0e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b582671-2c2c-4f6e-9648-4cefd2b0e597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da74b23-2a6a-49ac-90e4-b258de4b7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:26 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Volume 8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f', 'volume_size': 1, 'snapshot_id': '8a49629f-1a24-4e2a-8e88-718b4c2dff18'} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-bb97c9bb-de36-4a60-98c2-46e65bf89c16" returned: 0 in 0.342s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-bb97c9bb-de36-4a60-98c2-46e65bf89c16" released by "delete_volume" :: held 0.903s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Created reservations ['3a5e3cd7-4e65-4ceb-90e0-a1857d24b249', '1cbe904b-b435-4f1f-ac0b-28024dbc48b6', '508ccf42-f6d1-4f21-a5f7-5076d67608a7', '74f067a5-ab79-4472-b769-3eefa3716c27'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:26 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4" returned: 1 in 0.402s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_663499be-8210-498e-b13a-88acc42ee200_0bixtbr4' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3aadd9-df88-4a0a-9c70-d9ca64da95de]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.107s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-quobyte-8a49629f-1a24-4e2a-8e88-718b4c2dff18-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8a49629f-1a24-4e2a-8e88-718b4c2dff18-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Creating volume 8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f from snapshot 8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-quobyte-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Attempting download of 3837bc28-62b0-4fa1-80e6-e51e8108bd55 ((None, [{'url': 'file:///opt/stack/data/glance/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'metadata': {}}])) to volume e627b8df-c3a8-47b9-b5e4-af1441d4ce69. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD Jul 17 07:17:26 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] snapshot: 8a49629f-1a24-4e2a-8e88-718b4c2dff18, volume: 8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:26 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:26 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ddc462-a192-471e-ae92-d728b47ad90f]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[faffe82b-eaad-4f7d-9415-df8eb5d4e000]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-quobyte-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4" acquired by "delete_volume" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:26 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt Jul 17 07:17:26 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad969bec-f4f2-471c-abd8-13a210a11978]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 Jul 17 07:17:26 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.332s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Deleted volume successfully. Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bbf5843e-eebb-4621-a8cd-38d33abdc749 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-bb97c9bb-de36-4a60-98c2-46e65bf89c16-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:26 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD Jul 17 07:17:26 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 Jul 17 07:17:26 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18" returned: 0 in 0.500s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b61f3911-54f1-4890-a0d8-258258134971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc31dd3-55ca-4dce-bac4-a0df20ac1ca9]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] 663499be-8210-498e-b13a-88acc42ee200 was raw, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:17:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:26 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt Jul 17 07:17:26 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:26 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 Jul 17 07:17:26 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4" returned: 0 in 0.473s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:27 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:27 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4 Jul 17 07:17:27 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt" returned: 1 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3837bc28-62b0-4fa1-80e6-e51e8108bd55_xx603njt' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc4eaa-7e2a-42d6-bca6-e6970555c6fe]: (4, 'raw') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:27 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4" released by "delete_volume" :: held 0.847s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:27 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f Jul 17 07:17:27 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD Jul 17 07:17:27 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Created reservations ['0de0f729-cce5-4a3b-a4d6-c2ee85a5f82d', 'e0fafe57-0544-40fd-9d7d-bcfc0a63d2a8', '8b351221-1986-4036-be19-d95687926894', 'b7da77e6-e71a-4569-bf46-cad726b05e6e'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:27 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17" returned: 0 in 0.566s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_663499be-8210-498e-b13a-88acc42ee200_o_ksf7pddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:17:27 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:27 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:27 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 1G Jul 17 07:17:27 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:27 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD Jul 17 07:17:27 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:27 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:27 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Deleted volume successfully. Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cde2b3c9-b834-40b4-80ab-bc0bb54140f5 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-e1f2bdae-3b85-4b22-9566-83d01c0ef2b4-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:27 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 1G" returned: 0 in 0.486s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Downloaded image 663499be-8210-498e-b13a-88acc42ee200 ((None, [{'url': 'file:///opt/stack/data/glance/images/663499be-8210-498e-b13a-88acc42ee200', 'metadata': {}}])) to volume 4a667367-8157-4fc2-91ba-4eef00b08f17 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Temporary image 663499be-8210-498e-b13a-88acc42ee200 for user 9be651a6875040a78a325b310aa43f6c is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Marking volume 4a667367-8157-4fc2-91ba-4eef00b08f17 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Copying metadata from image 663499be-8210-498e-b13a-88acc42ee200 to 4a667367-8157-4fc2-91ba-4eef00b08f17. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Creating volume glance metadata for volume 4a667367-8157-4fc2-91ba-4eef00b08f17 backed by image 663499be-8210-498e-b13a-88acc42ee200 with: {'image_id': '663499be-8210-498e-b13a-88acc42ee200', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8ac0d47580a038c0900e275bf99597c8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:17:28 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD" returned: 1 in 0.523s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] 3837bc28-62b0-4fa1-80e6-e51e8108bd55 was raw, converting to qcow2 {{(pid=87331) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11c8742-7b24-497b-910d-a995cf7d8942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a667367-8157-4fc2-91ba-4eef00b08f17', 'volume_size': 1, 'image_id': '663499be-8210-498e-b13a-88acc42ee200', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/663499be-8210-498e-b13a-88acc42ee200', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ac0d47580a038c0900e275bf99597c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc7581d7df3c4af7b873e02643718cbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cde12bbb36f24cea89c3472d1c6f3c8f2bcc118b7a4a9d687c178fcd38d2d3524e80f142be2be3bf9fe2d899f3536cf9f6786fb256c590f4f764699a63d163ad', 'id': '663499be-8210-498e-b13a-88acc42ee200', 'created_at': datetime.datetime(2026, 7, 17, 5, 17, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 17, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/663499be-8210-498e-b13a-88acc42ee200/file', 'properties': {}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c264b4-1d27-400a-9eb6-15ce25232e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:28 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 Jul 17 07:17:28 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Volume volume-4a667367-8157-4fc2-91ba-4eef00b08f17 (4a667367-8157-4fc2-91ba-4eef00b08f17): created successfully Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c264b4-1d27-400a-9eb6-15ce25232e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Flow 'volume_create_manager' (2a567b6c-6e36-44f2-83ca-f2d4322c0d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e9ba755e-ebf5-4413-b89e-f44ede1c561f tempest-VolumeImageDependencyTests-452737218 None] Created volume successfully. Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-9953e522-deb7-48f8-9eb6-59b425e8e3b3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-9953e522-deb7-48f8-9eb6-59b425e8e3b3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Acquiring lock "cinder-4a667367-8157-4fc2-91ba-4eef00b08f17-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "cinder-quobyte-9953e522-deb7-48f8-9eb6-59b425e8e3b3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Lock "cinder-4a667367-8157-4fc2-91ba-4eef00b08f17-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-9953e522-deb7-48f8-9eb6-59b425e8e3b3" acquired by "delete_volume" :: waited 0.132s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Acquiring lock "cinder-quobyte-4a667367-8157-4fc2-91ba-4eef00b08f17" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Lock "cinder-quobyte-4a667367-8157-4fc2-91ba-4eef00b08f17" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c7b1f5-4a67-4a34-8cb5-1a5833e435ab]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40eb6e6-9370-4e15-8a10-3944dfa768e6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:29 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" returned: 0 in 1.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3837bc28-62b0-4fa1-80e6-e51e8108bd55_6_qq7kn1devstack@QuobyteHD, size 0.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:17:29 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Converted 0.00 MB image at 0.00 MB/s Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:29 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 Jul 17 07:17:29 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:29 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 1G Jul 17 07:17:29 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:29 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 Jul 17 07:17:29 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:30 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:30 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:30 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3" returned: 0 in 0.867s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:30 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17" returned: 0 in 0.990s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:30 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3 Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:30 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:30 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17 Jul 17 07:17:30 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:30 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 1G" returned: 0 in 0.928s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Downloaded image 3837bc28-62b0-4fa1-80e6-e51e8108bd55 ((None, [{'url': 'file:///opt/stack/data/glance/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'metadata': {}}])) to volume e627b8df-c3a8-47b9-b5e4-af1441d4ce69 successfully. {{(pid=87331) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Temporary image 3837bc28-62b0-4fa1-80e6-e51e8108bd55 for user 87f97cd2e43b402d9dab86feeddd89d3 is deleted. {{(pid=87331) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.volume_utils [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Marking volume e627b8df-c3a8-47b9-b5e4-af1441d4ce69 as bootable. {{(pid=87331) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Copying metadata from image 3837bc28-62b0-4fa1-80e6-e51e8108bd55 to e627b8df-c3a8-47b9-b5e4-af1441d4ce69. {{(pid=87331) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Creating volume glance metadata for volume e627b8df-c3a8-47b9-b5e4-af1441d4ce69 backed by image 3837bc28-62b0-4fa1-80e6-e51e8108bd55 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '87217e6a4562ef694fe0a8daa96c6f2f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87331) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 17 07:17:30 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9953e522-deb7-48f8-9eb6-59b425e8e3b3" returned: 0 in 0.636s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6d23b5-985f-4edf-9ae4-62a788547a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69', 'volume_size': 1, 'image_id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87217e6a4562ef694fe0a8daa96c6f2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '36472ae2366948a59937f2ce1ebe32d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d52fc73d15521fe013c8c02ab99fe77ac25aa614d51d20f94ad64da64d67bb1f91b24ec395c80fa19cb8dc2f18171c4665c8fbf76dddd2e54853a4167579295', 'id': '3837bc28-62b0-4fa1-80e6-e51e8108bd55', 'created_at': datetime.datetime(2026, 7, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 5, 17, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3837bc28-62b0-4fa1-80e6-e51e8108bd55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873f4ec6-b97f-4bfc-90db-a790715119ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-quobyte-9953e522-deb7-48f8-9eb6-59b425e8e3b3" released by "delete_volume" :: held 1.692s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:30 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.947s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:30 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Volume volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 (e627b8df-c3a8-47b9-b5e4-af1441d4ce69): created successfully Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873f4ec6-b97f-4bfc-90db-a790715119ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Flow 'volume_create_manager' (c1f0dc68-2e2d-4063-a85d-ae41e56afdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:17:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:17:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3b6a0e6c-0c48-47a5-86d8-3873527ad7ea tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Created volume successfully. Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Created reservations ['c34ab715-9938-47c8-b62f-1f55603b8eee', 'f7ec8b1d-7441-4f27-8e9c-8f2ea3a98e61', 'aa8d7d82-1ca0-4c5a-ad2a-79895a7cc366', '32b01a27-5bca-4a35-860a-821166596d8a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:31 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4a667367-8157-4fc2-91ba-4eef00b08f17" returned: 0 in 0.923s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Lock "cinder-quobyte-4a667367-8157-4fc2-91ba-4eef00b08f17" released by "delete_volume" :: held 2.024s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Created reservations ['7020b065-92a5-4508-a0e5-9af562a4d71e', 'd987dfb4-6b60-4ea5-b033-8cb4cc689433', '39cae0f3-30e8-4718-ba2e-0c9cda460728', 'ca58f64c-e6a4-475e-ab28-cef12a862b62'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:31 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:31 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Acquiring lock "cinder-e627b8df-c3a8-47b9-b5e4-af1441d4ce69-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "cinder-e627b8df-c3a8-47b9-b5e4-af1441d4ce69-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Acquiring lock "cinder-quobyte-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:32 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:32 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "cinder-quobyte-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a11f9c2-2fd3-4b6f-bdd4-69c68a10e190]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:32 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.802s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Deleted volume successfully. Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-46fdc599-cf9c-4c7a-bd7f-56b04d62f5e6 tempest-CreateVolumesFromImageTest-919214476 None] Lock "cinder-9953e522-deb7-48f8-9eb6-59b425e8e3b3-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:32 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 Jul 17 07:17:32 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:32 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.647s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Deleted volume successfully. Jul 17 07:17:32 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c20579d4-ae56-44e3-8064-005d87ca1007 tempest-VolumeImageDependencyTests-452737218 None] Lock "cinder-4a667367-8157-4fc2-91ba-4eef00b08f17-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:33 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" returned: 0 in 0.875s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:33 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69 Jul 17 07:17:33 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:33 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" returned: 0 in 0.502s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:33 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" returned: 0 in 6.223s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "cinder-quobyte-e627b8df-c3a8-47b9-b5e4-af1441d4ce69" released by "delete_volume" :: held 1.513s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd8f517-3d35-4acd-b532-e91f90a8c165]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Created reservations ['40c862a7-68b7-44fb-9dd3-de3c972d72d9', 'a6aab767-eb94-422d-9bf4-fa4d9249a744', '4f385e2a-3296-42b7-a536-bb4cfbcb6439', 'b0fc028f-1fd4-41c7-92d8-9d8836ff6946'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:33 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:33 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:33 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:33 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:34 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.302s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Deleted volume successfully. Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ec862a04-cbdd-4497-98d8-8bdb9461f245 tempest-VolumeAndVolumeTypeFromImageTest-2132280751 None] Lock "cinder-e627b8df-c3a8-47b9-b5e4-af1441d4ce69-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:34 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.763s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:17:34 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Converted 1024.00 MB image at 164.53 MB/s Jul 17 07:17:34 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f is being set with open permissions: ugo+rw Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:34 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f Jul 17 07:17:34 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:34 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" returned: 0 in 0.326s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" released by "_copy_volume_from_snapshot" :: held 8.394s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8a49629f-1a24-4e2a-8e88-718b4c2dff18-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" released by "_create_volume_from_snapshot" :: held 8.480s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.521s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da74b23-2a6a-49ac-90e4-b258de4b7549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f', 'volume_size': 1, 'snapshot_id': '8a49629f-1a24-4e2a-8e88-718b4c2dff18'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcc7f47-19b0-4b18-8d3d-5b3739dc6e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:34 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Volume volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f (8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f): created successfully Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcc7f47-19b0-4b18-8d3d-5b3739dc6e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:34 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Flow 'volume_create_manager' (bd1ac8f5-efa4-45ce-9256-c71dce273e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6f141bd2-c3d8-4fbe-a3cf-9048a00da107 tempest-VolumeDependencyTests-934523925 None] Created volume successfully. Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-8a49629f-1a24-4e2a-8e88-718b4c2dff18-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Lock "cinder-8a49629f-1a24-4e2a-8e88-718b4c2dff18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-quobyte-b61f3911-54f1-4890-a0d8-258258134971" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-b61f3911-54f1-4890-a0d8-258258134971" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-quobyte-8a49629f-1a24-4e2a-8e88-718b4c2dff18" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8a49629f-1a24-4e2a-8e88-718b4c2dff18" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Deleting offline snapshot 8a49629f-1a24-4e2a-8e88-718b4c2dff18 of volume b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] snapshot_file for this snap is: volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bc6185-6da9-4066-9b07-0e7abcf71b83]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:35 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 Jul 17 07:17:35 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:35 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18" returned: 0 in 0.451s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b61f3911-54f1-4890-a0d8-258258134971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf3b112-c104-490d-a8d0-15388272fbc5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:35 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:35 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:36 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.537s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:36 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 Jul 17 07:17:36 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:36 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18" returned: 0 in 0.464s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:36 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18 Jul 17 07:17:36 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:37 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971.8a49629f-1a24-4e2a-8e88-718b4c2dff18" returned: 0 in 0.366s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8a49629f-1a24-4e2a-8e88-718b4c2dff18" released by "_delete_snapshot" :: held 1.968s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-b61f3911-54f1-4890-a0d8-258258134971" released by "delete_snapshot" :: held 2.012s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (8adf1f8d-7326-460d-8834-c556c565cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85e5d9f-fde7-4557-8ab2-1413dda52065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85e5d9f-fde7-4557-8ab2-1413dda52065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981758248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8809c759-261f-4691-a5ae-ff7d74932ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:37Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324fbd41-52c5-47f9-8a64-112135881fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324fbd41-52c5-47f9-8a64-112135881fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501b0866-578c-4abd-aa29-f1568fcd4842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501b0866-578c-4abd-aa29-f1568fcd4842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8809c759-261f-4691-a5ae-ff7d74932ca4', 'volume_name': 'volume-8809c759-261f-4691-a5ae-ff7d74932ca4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd41efff-af0f-4e2c-a95d-e59463edcc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd41efff-af0f-4e2c-a95d-e59463edcc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aea2da-cede-4124-8767-ed6bf55cfa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume 8809c759-261f-4691-a5ae-ff7d74932ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8809c759-261f-4691-a5ae-ff7d74932ca4', 'volume_size': 1} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981758248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8809c759-261f-4691-a5ae-ff7d74932ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:37Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating volume 8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:37 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:37 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 1073741824 Jul 17 07:17:37 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Created reservations ['f4326c5a-5796-4baf-9168-2df6f636fdbb', 'd1b5aa26-2288-42d1-802f-48309cc9df1b', 'ee99c749-1b72-4975-804b-a273a976445d', '09f84ed6-e5b9-47d9-aedf-cccf773f9e5d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Flow 'volume_create_manager' (ad364448-adac-42b0-9e25-ca3261279b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5aeb116-eccc-4907-83a7-d2c2153c2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5aeb116-eccc-4907-83a7-d2c2153c2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534fb4c1-8549-4000-9afd-375f4ef0670b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9a4b8ff124ec8bed84361fb7a22a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:37Z,use_quota=True,user_id='90878bca0078409882e93591c9c9a2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d76d04-3344-4d94-9d7a-18333abfda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d76d04-3344-4d94-9d7a-18333abfda4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1b6f33-95cd-4a16-9814-66a06a73a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1b6f33-95cd-4a16-9814-66a06a73a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534fb4c1-8549-4000-9afd-375f4ef0670b', 'volume_name': 'volume-534fb4c1-8549-4000-9afd-375f4ef0670b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854352d8-c1ff-478b-9988-38e2d1244791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854352d8-c1ff-478b-9988-38e2d1244791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50316a2b-028c-4539-a551-3ea8bf8d4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:37 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Volume 534fb4c1-8549-4000-9afd-375f4ef0670b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534fb4c1-8549-4000-9afd-375f4ef0670b', 'volume_size': 1} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:37 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Delete snapshot completed successfully. Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-163341a5-3099-4250-87c1-796a5ed3cf8d tempest-VolumeDependencyTests-934523925 None] Lock "cinder-8a49629f-1a24-4e2a-8e88-718b4c2dff18-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:37 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 1073741824" returned: 0 in 0.491s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:37 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 Jul 17 07:17:37 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:38 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534fb4c1-8549-4000-9afd-375f4ef0670b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9a4b8ff124ec8bed84361fb7a22a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:37Z,use_quota=True,user_id='90878bca0078409882e93591c9c9a2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Creating volume 534fb4c1-8549-4000-9afd-375f4ef0670b {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:38 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aea2da-cede-4124-8767-ed6bf55cfa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8809c759-261f-4691-a5ae-ff7d74932ca4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b48662e-8233-415f-8c82-c8ce3c2465a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:38 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b 1073741824 Jul 17 07:17:38 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:38 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume volume-8809c759-261f-4691-a5ae-ff7d74932ca4 (8809c759-261f-4691-a5ae-ff7d74932ca4): created successfully Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b48662e-8233-415f-8c82-c8ce3c2465a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (8adf1f8d-7326-460d-8834-c556c565cd79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3facfee5-de0a-4a52-8073-b3e2b1e666ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Created volume successfully. Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-b61f3911-54f1-4890-a0d8-258258134971-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-b61f3911-54f1-4890-a0d8-258258134971-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-quobyte-b61f3911-54f1-4890-a0d8-258258134971" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-b61f3911-54f1-4890-a0d8-258258134971" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[543591bd-69f6-4654-b4e6-d9a5559cafb0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:38 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:38 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:38 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b 1073741824" returned: 0 in 0.545s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:38 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b Jul 17 07:17:38 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:38 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:38 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971 Jul 17 07:17:38 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:38 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:38 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50316a2b-028c-4539-a551-3ea8bf8d4148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534fb4c1-8549-4000-9afd-375f4ef0670b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148fd46d-526c-4a28-91df-cce4060d1f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Volume volume-534fb4c1-8549-4000-9afd-375f4ef0670b (534fb4c1-8549-4000-9afd-375f4ef0670b): created successfully Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148fd46d-526c-4a28-91df-cce4060d1f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Flow 'volume_create_manager' (ad364448-adac-42b0-9e25-ca3261279b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-23ddcf8e-0733-40f6-9f09-b91223526764 tempest-CinderUnicodeTest-1997530858 None] Created volume successfully. Jul 17 07:17:39 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b61f3911-54f1-4890-a0d8-258258134971" returned: 0 in 0.281s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-b61f3911-54f1-4890-a0d8-258258134971" released by "delete_volume" :: held 0.784s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Created reservations ['cefdbef1-7489-4d18-8e55-f24e0ec81f29', '9603573a-5517-4690-aae6-b98f3f30db35', '471c6f7a-bf25-4e64-834f-e2221ff8ad6b', 'f150be32-3e71-4895-8816-fb29a40fab11'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating offline snapshot 1846e0a1-1b71-414b-ad76-438d630b003c of volume 8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2a8dc-bd07-492c-a5f1-158451fe19f6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:39 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:39 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:39 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 Jul 17 07:17:39 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "cinder-quobyte-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c75473-0564-4802-bbbc-b5de41aa2113]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:39 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:39 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f Jul 17 07:17:39 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.523s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:39 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:39 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Deleted volume successfully. Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Flow 'volume_create_manager' (1ff69800-fe20-4932-a354-465c2031d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:40 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d460190-1f3d-4985-b44c-fc4640f36a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-269127ba-ebf4-4452-a87d-7c6b37a58202 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-b61f3911-54f1-4890-a0d8-258258134971-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4" returned: 0 in 0.665s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d460190-1f3d-4985-b44c-fc4640f36a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-557358142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9149bb-495c-4905-8077-82a82d36a683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9a4b8ff124ec8bed84361fb7a22a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:40Z,use_quota=True,user_id='90878bca0078409882e93591c9c9a2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:40 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c 1G Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3529fa-96e3-4ac5-b418-05007f2fe240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:40 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3529fa-96e3-4ac5-b418-05007f2fe240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd787ccc-f2b2-425a-8668-cfe4d3fb4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd787ccc-f2b2-425a-8668-cfe4d3fb4980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9149bb-495c-4905-8077-82a82d36a683', 'volume_name': 'volume-8e9149bb-495c-4905-8077-82a82d36a683', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20d2734-8886-45e1-9b83-086f98b3fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20d2734-8886-45e1-9b83-086f98b3fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dc466c-bfe9-48d5-bde9-82ccab452b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Volume 8e9149bb-495c-4905-8077-82a82d36a683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9149bb-495c-4905-8077-82a82d36a683', 'volume_size': 1} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:40 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" returned: 0 in 0.507s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:40 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f Jul 17 07:17:40 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-5b249ba3-1199-4b61-b7ac-f27047058852 tempest-ProjectAdminTests-120713745 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87331) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 17 07:17:40 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c 1G" returned: 0 in 0.479s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8809c759-261f-4691-a5ae-ff7d74932ca4 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:40 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" returned: 0 in 0.281s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-quobyte-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f" released by "delete_volume" :: held 0.857s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:40 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8809c759-261f-4691-a5ae-ff7d74932ca4 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c Jul 17 07:17:40 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Created reservations ['afd46de4-d8a6-4ad2-8bdd-948b20fc2b4e', 'c31278b0-333c-4b9c-bc6e-f93c07a89560', '1884d675-4bd5-413d-82b8-6f203f3dcc71', '0bbce987-751e-4d1a-9498-0ef7d7bd2e17'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:40 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:40 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:40 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8809c759-261f-4691-a5ae-ff7d74932ca4 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c" returned: 0 in 0.352s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:40 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c is being set with open permissions: ugo+rw Jul 17 07:17:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:40 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c Jul 17 07:17:40 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:41 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.333s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Deleted volume successfully. Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c5523dee-7e50-4683-b6dd-a9fe31e44886 tempest-VolumeDependencyTests-934523925 None] Lock "cinder-8ebe7f7b-e217-403f-bd9b-cb0e91fa9f3f-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:41 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c" returned: 0 in 0.362s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:41 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info Jul 17 07:17:41 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:41 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info" returned: 0 in 0.322s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:41 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info is being set with open permissions: ugo+rw Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:41 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info Jul 17 07:17:41 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:41 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.info" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-557358142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9149bb-495c-4905-8077-82a82d36a683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e9a4b8ff124ec8bed84361fb7a22a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:40Z,use_quota=True,user_id='90878bca0078409882e93591c9c9a2f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Creating volume 8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:41 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-abb8c197-8e59-4218-b888-e384c222f7a2 tempest-CreateVolumesFromSnapshotTest-971958600 None] Create snapshot completed successfully Jul 17 07:17:41 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 1073741824 Jul 17 07:17:41 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:42 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 1073741824" returned: 0 in 0.612s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:42 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 Jul 17 07:17:42 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:43 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dc466c-bfe9-48d5-bde9-82ccab452b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9149bb-495c-4905-8077-82a82d36a683', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df231c85-a2f4-4400-9e4a-68c1529dee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Volume volume-8e9149bb-495c-4905-8077-82a82d36a683 (8e9149bb-495c-4905-8077-82a82d36a683): created successfully Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df231c85-a2f4-4400-9e4a-68c1529dee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Flow 'volume_create_manager' (1ff69800-fe20-4932-a354-465c2031d523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:43 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cabce89d-d70b-4588-be16-dd92168f8d3d tempest-CinderUnicodeTest-1997530858 None] Created volume successfully. Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (7cb37c56-7f24-4d4e-ae55-39eda7f02f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9218ea2-793d-48fc-84d4-84612a02348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9218ea2-793d-48fc-84d4-84612a02348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703484162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba1a789-fc46-4eed-9cc7-59a10835b08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:43Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c3d382-a672-4408-b12b-7ae49f72448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c3d382-a672-4408-b12b-7ae49f72448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9d0339-7fc9-4c8c-b8ed-a6b689b9d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9d0339-7fc9-4c8c-b8ed-a6b689b9d51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba1a789-fc46-4eed-9cc7-59a10835b08d', 'volume_name': 'volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbaf512-0eb4-4deb-8480-b23e53c37a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbaf512-0eb4-4deb-8480-b23e53c37a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d798011b-cbc5-456b-aed4-6418a17b9d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume 6ba1a789-fc46-4eed-9cc7-59a10835b08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d', 'volume_size': 1} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703484162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba1a789-fc46-4eed-9cc7-59a10835b08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:43Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating volume 6ba1a789-fc46-4eed-9cc7-59a10835b08d {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:43 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:43 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d 1073741824 Jul 17 07:17:43 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (113fea8b-623a-40ac-b36f-dbe68247b5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6126c8-4108-4848-b600-f6a2c3fd7cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6126c8-4108-4848-b600-f6a2c3fd7cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429994298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e8e860-8762-40c8-9cce-1c5f10f99eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:44Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc67c46f-c28f-48f7-b401-3d4bb1f69e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc67c46f-c28f-48f7-b401-3d4bb1f69e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2033869-8369-472a-bde0-95688d85af3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2033869-8369-472a-bde0-95688d85af3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e8e860-8762-40c8-9cce-1c5f10f99eeb', 'volume_name': 'volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554ab976-373e-4dce-a914-d8063fd5855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554ab976-373e-4dce-a914-d8063fd5855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88319b2c-bea3-48ad-9e04-216ba82a3ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume 91e8e860-8762-40c8-9cce-1c5f10f99eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb', 'volume_size': 1} Jul 17 07:17:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:43 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d 1073741824" returned: 0 in 0.699s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:44 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d Jul 17 07:17:44 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (fdcfbb1c-8a5f-45ab-bc06-c2bfb266932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4c71f5-481b-4efd-ae1b-53b2a4ebd3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4c71f5-481b-4efd-ae1b-53b2a4ebd3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042723090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b556bc-d243-4831-a317-5e079a31295f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:44Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23403a-0b11-4b3e-97dd-4b9b65487d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23403a-0b11-4b3e-97dd-4b9b65487d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14795f2e-370a-4d2d-9af6-5c7b31f63512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14795f2e-370a-4d2d-9af6-5c7b31f63512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b556bc-d243-4831-a317-5e079a31295f', 'volume_name': 'volume-b1b556bc-d243-4831-a317-5e079a31295f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077c06a3-2621-47ed-ac50-e179d698e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077c06a3-2621-47ed-ac50-e179d698e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770b7af-dcdc-4fba-a22d-246f1dd61afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume b1b556bc-d243-4831-a317-5e079a31295f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b556bc-d243-4831-a317-5e079a31295f', 'volume_size': 1} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:44 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d" returned: 0 in 0.456s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429994298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e8e860-8762-40c8-9cce-1c5f10f99eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:44Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating volume 91e8e860-8762-40c8-9cce-1c5f10f99eeb {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:44 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d798011b-cbc5-456b-aed4-6418a17b9d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c77355-6502-4c7f-87fa-9c2ca37f75a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:44 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb 1073741824 Jul 17 07:17:44 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:44 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d (6ba1a789-fc46-4eed-9cc7-59a10835b08d): created successfully Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c77355-6502-4c7f-87fa-9c2ca37f75a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (7cb37c56-7f24-4d4e-ae55-39eda7f02f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:44 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-810c125e-51b9-4486-9f9b-05d179be3312 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created volume successfully. Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (6a03c071-1e9d-4733-ab2e-eec1dee838a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:44 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcab140-be39-4ea9-b765-ab177fdcc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcab140-be39-4ea9-b765-ab177fdcc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351158059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b94c6bc-b5cf-43db-be26-62699e30c338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:45Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a1a7c7-d159-44eb-a06e-d8c5ab9d7270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a1a7c7-d159-44eb-a06e-d8c5ab9d7270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6c394f-38a3-4cf1-bd6a-b9f7d542bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6c394f-38a3-4cf1-bd6a-b9f7d542bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b94c6bc-b5cf-43db-be26-62699e30c338', 'volume_name': 'volume-0b94c6bc-b5cf-43db-be26-62699e30c338', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad02c5e-4dd4-4345-a9a5-529da66323b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad02c5e-4dd4-4345-a9a5-529da66323b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b2752b-f254-433f-ac30-4d6483000bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume 0b94c6bc-b5cf-43db-be26-62699e30c338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b94c6bc-b5cf-43db-be26-62699e30c338', 'volume_size': 1} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:45 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (e6af3491-258a-44ce-9f50-f5ea22ed1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9206300-fd55-4429-9358-a0164e22e1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb 1073741824" returned: 0 in 0.812s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9206300-fd55-4429-9358-a0164e22e1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456875714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34eea4a-4e5b-4b72-bb6b-f89077666e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:45Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcea382-94da-496b-bbd7-1cf1441be338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcea382-94da-496b-bbd7-1cf1441be338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14ff48-41be-44f3-a33f-9f047ed315f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14ff48-41be-44f3-a33f-9f047ed315f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34eea4a-4e5b-4b72-bb6b-f89077666e18', 'volume_name': 'volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee3980e-dd67-4298-8c55-0225cb4e5112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee3980e-dd67-4298-8c55-0225cb4e5112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf558ea-bfa7-4a6b-8c86-f049c48eb235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume f34eea4a-4e5b-4b72-bb6b-f89077666e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18', 'volume_size': 1} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:45 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb Jul 17 07:17:45 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:45 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042723090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b556bc-d243-4831-a317-5e079a31295f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:44Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating volume b1b556bc-d243-4831-a317-5e079a31295f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:45 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88319b2c-bea3-48ad-9e04-216ba82a3ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f 1073741824 Jul 17 07:17:45 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780f7cee-28c9-48d6-ac44-935372d16faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:45 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb (91e8e860-8762-40c8-9cce-1c5f10f99eeb): created successfully Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780f7cee-28c9-48d6-ac44-935372d16faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:45 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (113fea8b-623a-40ac-b36f-dbe68247b5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:45 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8081f114-1276-478a-8b46-a422bd978244 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created volume successfully. Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (d5d3a55e-1253-476e-9abb-383e2545adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0f32a2-27a3-4ad8-971f-ef9e4ef4a7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:46 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0f32a2-27a3-4ad8-971f-ef9e4ef4a7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926167331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14aefe7a-87be-4e40-911a-a126e6c1901b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:46Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec684bbc-4bae-479b-b2f2-b6c4728c21f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec684bbc-4bae-479b-b2f2-b6c4728c21f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ab0170-99e3-4065-8861-22a0bf871ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ab0170-99e3-4065-8861-22a0bf871ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14aefe7a-87be-4e40-911a-a126e6c1901b', 'volume_name': 'volume-14aefe7a-87be-4e40-911a-a126e6c1901b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed62373-4df7-4dfd-b418-3ddf5ea377e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed62373-4df7-4dfd-b418-3ddf5ea377e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77d2279-b5f3-4ad4-a060-da72a2d159b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:46 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Volume 14aefe7a-87be-4e40-911a-a126e6c1901b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14aefe7a-87be-4e40-911a-a126e6c1901b', 'volume_size': 1} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f 1073741824" returned: 0 in 0.523s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:46 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f Jul 17 07:17:46 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:46 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f" returned: 0 in 0.271s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351158059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b94c6bc-b5cf-43db-be26-62699e30c338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:45Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating volume 0b94c6bc-b5cf-43db-be26-62699e30c338 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:46 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770b7af-dcdc-4fba-a22d-246f1dd61afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b556bc-d243-4831-a317-5e079a31295f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:46 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 1073741824 Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0887e11-3c2b-4463-967f-43d9f4f3e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:46 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:46 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume volume-b1b556bc-d243-4831-a317-5e079a31295f (b1b556bc-d243-4831-a317-5e079a31295f): created successfully Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0887e11-3c2b-4463-967f-43d9f4f3e966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:46 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (fdcfbb1c-8a5f-45ab-bc06-c2bfb266932e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:46 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-19b39ea2-a862-4ee6-b6b1-8cd5cc1f28ae tempest-CreateVolumesFromSnapshotTest-971958600 None] Created volume successfully. Jul 17 07:17:47 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 1073741824" returned: 0 in 0.469s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:47 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 Jul 17 07:17:47 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:47 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.266s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b2752b-f254-433f-ac30-4d6483000bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b94c6bc-b5cf-43db-be26-62699e30c338', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2358dc8a-e172-4f0f-8c32-fa5b6939d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Creating offline snapshot aaef2486-d00f-4575-9c78-f582152aceb5 of volume 8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:17:47 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume volume-0b94c6bc-b5cf-43db-be26-62699e30c338 (0b94c6bc-b5cf-43db-be26-62699e30c338): created successfully Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2358dc8a-e172-4f0f-8c32-fa5b6939d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (6a03c071-1e9d-4733-ab2e-eec1dee838a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaefa22-cef1-4012-8bd1-56b10aae2c4b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0971b046-e765-4113-a40c-6b95cc4f2db9 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created volume successfully. Jul 17 07:17:47 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 Jul 17 07:17:47 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:47 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:47 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 1G Jul 17 07:17:47 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:48 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 1G" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9149bb-495c-4905-8077-82a82d36a683 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:48 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9149bb-495c-4905-8077-82a82d36a683 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 Jul 17 07:17:48 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:48 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9149bb-495c-4905-8077-82a82d36a683 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5" returned: 0 in 0.312s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:48 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 is being set with open permissions: ugo+rw Jul 17 07:17:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:48 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 Jul 17 07:17:48 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:48 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5" returned: 0 in 0.257s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:48 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info Jul 17 07:17:48 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:49 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info" returned: 0 in 0.255s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:49 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info is being set with open permissions: ugo+rw Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:49 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info Jul 17 07:17:49 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:49 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.info" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456875714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34eea4a-4e5b-4b72-bb6b-f89077666e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cea4e2e278b4b5c98dbb969f2c1bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:45Z,use_quota=True,user_id='66c91f60838648a18aadf0c4468fbd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Creating volume f34eea4a-4e5b-4b72-bb6b-f89077666e18 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:49 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:49 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 1073741824 Jul 17 07:17:49 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-14ec4eae-98b8-4143-9909-d045283af22f tempest-CinderUnicodeTest-1997530858 None] Create snapshot completed successfully Jul 17 07:17:49 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 1073741824" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:49 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 Jul 17 07:17:49 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-aaef2486-d00f-4575-9c78-f582152aceb5-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-aaef2486-d00f-4575-9c78-f582152aceb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-quobyte-8e9149bb-495c-4905-8077-82a82d36a683" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-8e9149bb-495c-4905-8077-82a82d36a683" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-quobyte-aaef2486-d00f-4575-9c78-f582152aceb5" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-aaef2486-d00f-4575-9c78-f582152aceb5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Deleting offline snapshot aaef2486-d00f-4575-9c78-f582152aceb5 of volume 8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] snapshot_file for this snap is: volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0be09e-1cf5-46f7-ada1-33df2d4f0636]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:50 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18" returned: 0 in 0.292s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.984s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926167331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14aefe7a-87be-4e40-911a-a126e6c1901b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:46Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Creating volume 14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:50 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf558ea-bfa7-4a6b-8c86-f049c48eb235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:50 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b 1073741824 Jul 17 07:17:50 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1f0a48-9c16-4586-8a26-9b7e316bb3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:50 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Volume volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 (f34eea4a-4e5b-4b72-bb6b-f89077666e18): created successfully Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1f0a48-9c16-4586-8a26-9b7e316bb3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Flow 'volume_create_manager' (e6af3491-258a-44ce-9f50-f5ea22ed1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:50 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-29ec5238-1fdc-410b-9dda-cf71129a2a87 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created volume successfully. Jul 17 07:17:50 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 Jul 17 07:17:50 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:50 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5" returned: 0 in 0.412s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e9149bb-495c-4905-8077-82a82d36a683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa79ca7-59dc-4b4e-8ab3-f6e62a6d1b3c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:50 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 Jul 17 07:17:50 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:50 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b 1073741824" returned: 0 in 0.522s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:50 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b Jul 17 07:17:50 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:51 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:51 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-f34eea4a-4e5b-4b72-bb6b-f89077666e18-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b" returned: 0 in 0.285s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:51 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 Jul 17 07:17:51 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77d2279-b5f3-4ad4-a060-da72a2d159b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14aefe7a-87be-4e40-911a-a126e6c1901b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea8e955-f542-403e-a51b-3cb18147f125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-f34eea4a-4e5b-4b72-bb6b-f89077666e18-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:51 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Volume volume-14aefe7a-87be-4e40-911a-a126e6c1901b (14aefe7a-87be-4e40-911a-a126e6c1901b): created successfully Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea8e955-f542-403e-a51b-3cb18147f125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (d5d3a55e-1253-476e-9abb-383e2545adf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-25582b3f-4256-4bdd-aacc-e20f4f03e01e tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-f34eea4a-4e5b-4b72-bb6b-f89077666e18" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-f34eea4a-4e5b-4b72-bb6b-f89077666e18" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e75dc86-bee8-46d4-bba4-cbe3ba5d7c06]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:51 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 Jul 17 07:17:51 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:51 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5" returned: 0 in 0.524s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:51 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5 Jul 17 07:17:51 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:51 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18" returned: 0 in 0.465s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:51 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18 Jul 17 07:17:51 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:51 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683.aaef2486-d00f-4575-9c78-f582152aceb5" returned: 0 in 0.344s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot d871c34e-162d-4132-b3ee-3739cb4d305a of volume 14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[48390bb4-5446-4d14-8f95-b31ce1e01505]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-aaef2486-d00f-4575-9c78-f582152aceb5" released by "_delete_snapshot" :: held 1.850s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-8e9149bb-495c-4905-8077-82a82d36a683" released by "delete_snapshot" :: held 1.875s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:52 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f34eea4a-4e5b-4b72-bb6b-f89077666e18" returned: 0 in 0.340s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-f34eea4a-4e5b-4b72-bb6b-f89077666e18" released by "delete_volume" :: held 0.862s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Created reservations ['3d2ac6ca-21ae-414c-8ba8-b2d21bddca6f', '5925763e-d763-4748-9163-44a0a21e1dcc', '34c2a782-611e-4611-a1ad-3b1a823d96a8', '0cb157bc-ec45-4ff8-b255-ad62481b1f68'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:52 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b Jul 17 07:17:52 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['41a18c08-fa87-450a-b526-f4cb60bd6a27', 'abfa43a2-a543-46cf-989f-0886ab83b271', '89d74ef3-6100-4d7c-9975-78cbfd448a50', 'a46c12db-76ca-44ed-b54a-3a5e0ed317d4'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Delete snapshot completed successfully. Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71d9c594-2ef7-49cc-b3af-d3b1a06f09fb tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-aaef2486-d00f-4575-9c78-f582152aceb5-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-8e9149bb-495c-4905-8077-82a82d36a683-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:52 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:52 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-8e9149bb-495c-4905-8077-82a82d36a683-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-quobyte-8e9149bb-495c-4905-8077-82a82d36a683" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-8e9149bb-495c-4905-8077-82a82d36a683" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:52 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b" returned: 0 in 0.544s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0fbc94-d8b5-4176-9fec-04def091b258]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:52 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a 1G Jul 17 07:17:52 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:52 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 Jul 17 07:17:52 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:52 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.363s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleted volume successfully. Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-5fa46d9d-9ee6-4321-a6b5-46c078851369 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-f34eea4a-4e5b-4b72-bb6b-f89077666e18-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:52 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683" returned: 0 in 0.402s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:52 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683 Jul 17 07:17:52 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:53 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a 1G" returned: 0 in 0.485s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14aefe7a-87be-4e40-911a-a126e6c1901b -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:53 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14aefe7a-87be-4e40-911a-a126e6c1901b -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a Jul 17 07:17:53 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:53 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8e9149bb-495c-4905-8077-82a82d36a683" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-8e9149bb-495c-4905-8077-82a82d36a683" released by "delete_volume" :: held 0.749s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Created reservations ['9bfcb44d-cb82-4468-9225-e2c0e5159c2c', '8c34f49e-c3f8-4a38-9afb-8b18029be621', '837840c2-e1b3-49ad-a4b4-f79b6bd6db55', 'a9be5004-d3a9-4925-8a6e-25924540819c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:53 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14aefe7a-87be-4e40-911a-a126e6c1901b -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a" returned: 0 in 0.341s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:53 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a is being set with open permissions: ugo+rw Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:53 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a Jul 17 07:17:53 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-0b94c6bc-b5cf-43db-be26-62699e30c338-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:53 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:53 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-0b94c6bc-b5cf-43db-be26-62699e30c338-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-0b94c6bc-b5cf-43db-be26-62699e30c338" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-0b94c6bc-b5cf-43db-be26-62699e30c338" acquired by "delete_volume" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dd4110-7ba3-4bdf-ad63-9eef4057a7ac]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-534fb4c1-8549-4000-9afd-375f4ef0670b-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:53 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a" returned: 0 in 0.315s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-534fb4c1-8549-4000-9afd-375f4ef0670b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "cinder-quobyte-534fb4c1-8549-4000-9afd-375f4ef0670b" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:53 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 Jul 17 07:17:53 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-534fb4c1-8549-4000-9afd-375f4ef0670b" acquired by "delete_volume" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:53 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info Jul 17 07:17:53 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:53 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb6c9c0-c2ab-44e9-a062-ea2e2442312e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.444s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Deleted volume successfully. Jul 17 07:17:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1e0cbea4-da86-4315-a39e-88ccb5da3978 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-8e9149bb-495c-4905-8077-82a82d36a683-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:54 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b Jul 17 07:17:54 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:54 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338" returned: 0 in 0.501s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:54 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info" returned: 0 in 0.384s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info is being set with open permissions: ugo+rw Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:54 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338 Jul 17 07:17:54 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:54 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info Jul 17 07:17:54 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:54 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b" returned: 0 in 0.463s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:54 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b Jul 17 07:17:54 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:54 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0b94c6bc-b5cf-43db-be26-62699e30c338" returned: 0 in 0.278s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.info" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-0b94c6bc-b5cf-43db-be26-62699e30c338" released by "delete_volume" :: held 0.866s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a08472d3-6596-4e57-a51c-ae837291a742 tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['50444cb3-314d-48c8-8517-5996c8b68ed2', '0fa9b99e-7b34-4e53-bff6-abf04acbf8ca', '70d74055-82c6-402a-8e53-972bbb285830', '3d06cfe3-5678-411d-891d-c2ee19ecc148'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:54 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:54 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-534fb4c1-8549-4000-9afd-375f4ef0670b" returned: 0 in 0.304s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-quobyte-534fb4c1-8549-4000-9afd-375f4ef0670b" released by "delete_volume" :: held 0.852s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-b1b556bc-d243-4831-a317-5e079a31295f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-b1b556bc-d243-4831-a317-5e079a31295f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-b1b556bc-d243-4831-a317-5e079a31295f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-b1b556bc-d243-4831-a317-5e079a31295f" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Created reservations ['fced1ffa-54dc-418c-a5bd-0fa52a542d65', 'd6b88ec8-613f-469c-8b2c-2439ff90d7da', 'ec5464b6-269c-42b4-b668-4e5bfb41da18', '01b1f50c-4331-402d-bcb2-c695b53fcfb4'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcb6f3e-737e-4265-95b5-5f855c482825]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:54 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.319s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:54 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleted volume successfully. Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d03e0396-2c13-4a74-88d4-230fb72be2ce tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-0b94c6bc-b5cf-43db-be26-62699e30c338-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:54 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f Jul 17 07:17:54 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:54 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:54 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-d871c34e-162d-4132-b3ee-3739cb4d305a-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-d871c34e-162d-4132-b3ee-3739cb4d305a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-14aefe7a-87be-4e40-911a-a126e6c1901b" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-14aefe7a-87be-4e40-911a-a126e6c1901b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-d871c34e-162d-4132-b3ee-3739cb4d305a" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-d871c34e-162d-4132-b3ee-3739cb4d305a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot d871c34e-162d-4132-b3ee-3739cb4d305a of volume 14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[add7dd1e-94cc-4496-b184-797174ca5673]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:55 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f" returned: 0 in 0.444s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:55 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.345s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:55 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f Jul 17 07:17:55 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:55 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Deleted volume successfully. Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dcd1e81a-d966-420d-9b92-0d75691e2b09 tempest-CinderUnicodeTest-1997530858 None] Lock "cinder-534fb4c1-8549-4000-9afd-375f4ef0670b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:55 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a Jul 17 07:17:55 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Flow 'volume_create_manager' (f7b31072-1837-4589-8653-826d801d58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4ca521-6a37-4fb0-a3eb-2e9620cb8c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4ca521-6a37-4fb0-a3eb-2e9620cb8c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522983461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a2e95d-ede0-4f9d-ad59-50b7b538f6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede03f3a0c6b451daa8027de7a1c6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:55Z,use_quota=True,user_id='1cd42bb77fc84169a8d2b539dd12dbb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9e9545-db29-48a9-b1cf-b8a337c8218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9e9545-db29-48a9-b1cf-b8a337c8218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9704c2e-fe33-475e-b79c-f9a554b73929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9704c2e-fe33-475e-b79c-f9a554b73929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a2e95d-ede0-4f9d-ad59-50b7b538f6c0', 'volume_name': 'volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362ec764-0094-43fe-af86-6ea82a3751dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362ec764-0094-43fe-af86-6ea82a3751dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c3bfcf-97b1-4fc3-868b-8f3897828653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:55 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Volume 03a2e95d-ede0-4f9d-ad59-50b7b538f6c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0', 'volume_size': 1} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522983461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a2e95d-ede0-4f9d-ad59-50b7b538f6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede03f3a0c6b451daa8027de7a1c6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:17:55Z,use_quota=True,user_id='1cd42bb77fc84169a8d2b539dd12dbb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Creating volume 03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:55 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:55 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-b1b556bc-d243-4831-a317-5e079a31295f" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-b1b556bc-d243-4831-a317-5e079a31295f" released by "delete_volume" :: held 0.787s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:55 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 1073741824 Jul 17 07:17:55 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['996e0c62-da98-4462-bde3-f1e32451bf60', 'dadf8da4-fce3-4730-9c33-16273a1af066', '2ab2aecc-9aff-4c26-8a7c-d97d6c788c24', 'e6941edd-402a-49c7-89d2-4d8f5ca9e61a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:55 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a" returned: 0 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14aefe7a-87be-4e40-911a-a126e6c1901b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f943af79-1f47-4494-96ec-e804fd0169ca]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:55 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:55 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:55 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b Jul 17 07:17:55 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-91e8e860-8762-40c8-9cce-1c5f10f99eeb-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-91e8e860-8762-40c8-9cce-1c5f10f99eeb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-91e8e860-8762-40c8-9cce-1c5f10f99eeb" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-91e8e860-8762-40c8-9cce-1c5f10f99eeb" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[872c9571-bdfb-48e6-a8d9-74c1badde6d1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:56 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.312s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleted volume successfully. Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-8386b53a-11f1-420b-ba44-bc31644426ff tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-b1b556bc-d243-4831-a317-5e079a31295f-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:56 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb Jul 17 07:17:56 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:56 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 1073741824" returned: 0 in 0.636s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:56 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b" returned: 0 in 0.576s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:56 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 Jul 17 07:17:56 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:56 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a Jul 17 07:17:56 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:56 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb" returned: 0 in 0.456s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:56 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb Jul 17 07:17:56 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:56 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0" returned: 0 in 0.311s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c3bfcf-97b1-4fc3-868b-8f3897828653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f848ae14-7a84-4595-92c7-f30eb58b4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:56 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Volume volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 (03a2e95d-ede0-4f9d-ad59-50b7b538f6c0): created successfully Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f848ae14-7a84-4595-92c7-f30eb58b4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Flow 'volume_create_manager' (f7b31072-1837-4589-8653-826d801d58f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e9ade89e-d6e3-4ce6-b127-8a492cb9fcde tempest-ProjectReaderTests-1199773133 None] Created volume successfully. Jul 17 07:17:56 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:56 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a Jul 17 07:17:56 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:56 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-91e8e860-8762-40c8-9cce-1c5f10f99eeb" returned: 0 in 0.271s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-91e8e860-8762-40c8-9cce-1c5f10f99eeb" released by "delete_volume" :: held 0.774s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['3e170015-1f1f-41dc-884c-c5f13cd439a6', '0d572a31-df91-4914-a6fd-fb3fdb929c79', 'ec30cc7b-a9ee-4673-926b-f74f6be617dc', 'b7542cf8-355c-4d5a-bf9b-ff45b2a9bf14'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:56 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b.d871c34e-162d-4132-b3ee-3739cb4d305a" returned: 0 in 0.278s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:56 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:56 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-d871c34e-162d-4132-b3ee-3739cb4d305a" released by "_delete_snapshot" :: held 1.864s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-14aefe7a-87be-4e40-911a-a126e6c1901b" released by "delete_snapshot" :: held 1.891s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Created reservations ['391f5525-603d-43bf-b21f-8855bad42455', '07dc6845-c7df-4c46-b181-78ab0a3981ef', '8c0cc124-bec6-4552-8336-b4042984cc2a', 'b9bd941c-f5ec-4068-90f8-1ddec6b6a6dd'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-6ba1a789-fc46-4eed-9cc7-59a10835b08d-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-6ba1a789-fc46-4eed-9cc7-59a10835b08d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-83ec0f78-8069-48d5-a897-11a98532ccb1 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-d871c34e-162d-4132-b3ee-3739cb4d305a-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-6ba1a789-fc46-4eed-9cc7-59a10835b08d" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-6ba1a789-fc46-4eed-9cc7-59a10835b08d" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[598590e2-c095-4036-bd4d-c0905a8b84f6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:57 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-14aefe7a-87be-4e40-911a-a126e6c1901b-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.385s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleted volume successfully. Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Lock "cinder-14aefe7a-87be-4e40-911a-a126e6c1901b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-3e875428-4334-4fdd-a5e9-72c121685ed1 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-91e8e860-8762-40c8-9cce-1c5f10f99eeb-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-14aefe7a-87be-4e40-911a-a126e6c1901b" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:57 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d Jul 17 07:17:57 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-14aefe7a-87be-4e40-911a-a126e6c1901b" acquired by "delete_volume" :: waited 0.029s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacdec1f-685c-4b7f-b5ee-889c1649fc03]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:57 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b Jul 17 07:17:57 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:57 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d" returned: 0 in 0.503s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:57 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d Jul 17 07:17:57 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Acquiring lock "cinder-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:58 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b" returned: 0 in 0.493s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Acquiring lock "cinder-quobyte-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:58 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b Jul 17 07:17:58 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-quobyte-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5e1c5c-f0fb-4c93-8eb5-e9c80c0284ed]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:58 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6ba1a789-fc46-4eed-9cc7-59a10835b08d" returned: 0 in 0.339s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-6ba1a789-fc46-4eed-9cc7-59a10835b08d" released by "delete_volume" :: held 0.907s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['37b30872-0ddd-49fc-af8d-3cf493d89ae2', 'cb9ce308-72d4-496e-a489-935c8e9dd33f', '1954fe84-9750-4798-9738-be38e3095918', 'ae2ecb91-0254-416a-a05c-88eded8afab4'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:58 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 Jul 17 07:17:58 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:58 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:58 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:58 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-14aefe7a-87be-4e40-911a-a126e6c1901b" returned: 0 in 0.363s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-1846e0a1-1b71-414b-ad76-438d630b003c-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-14aefe7a-87be-4e40-911a-a126e6c1901b" released by "delete_volume" :: held 0.991s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-1846e0a1-1b71-414b-ad76-438d630b003c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-8809c759-261f-4691-a5ae-ff7d74932ca4" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-8809c759-261f-4691-a5ae-ff7d74932ca4" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-1846e0a1-1b71-414b-ad76-438d630b003c" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-1846e0a1-1b71-414b-ad76-438d630b003c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleting offline snapshot 1846e0a1-1b71-414b-ad76-438d630b003c of volume 8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:17:58 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] snapshot_file for this snap is: volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0" returned: 0 in 0.492s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aebf0e8-9235-4213-be8e-53fb3d09bd36]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:58 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0 Jul 17 07:17:58 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Created reservations ['bfccae83-ed57-4baf-938b-b3bfefa22d7b', '8049c610-c0ff-44f0-9252-2cb8722a6eb0', '38114302-b5cc-45e3-8e47-ca31db9e1c6c', 'f9126794-562f-4d02-9553-e0bfd4035ac9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:58 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:58 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleted volume successfully. Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:58 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c Jul 17 07:17:58 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b3043923-4c00-4c63-81f0-d6353d047448 tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-6ba1a789-fc46-4eed-9cc7-59a10835b08d-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:58 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:58 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:58 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0" returned: 0 in 0.306s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-quobyte-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0" released by "delete_volume" :: held 0.848s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:58 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Created reservations ['cb7f45b2-075b-483b-9c49-56718cd9fe5d', '4b6f42ea-43ae-42d1-864f-6544bd1c3586', '45e74b29-1ae7-40c3-8d9d-e5ce25e4a49c', '30a21c08-508f-4c48-b303-4a2a0b04a12a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:59 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:59 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.333s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c" returned: 0 in 0.500s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8809c759-261f-4691-a5ae-ff7d74932ca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:17:59 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:17:59 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8b73e-f32d-4a82-834a-23c1c1a7748c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1d9ed927-d0c2-4127-9773-6481c6a5d35a tempest-ProjectMemberTests-1934738256 None] Lock "cinder-14aefe7a-87be-4e40-911a-a126e6c1901b-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:59 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 Jul 17 07:17:59 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:59 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.323s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:17:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Deleted volume successfully. Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-d1924df0-93cd-4259-bd4a-54b80d422563 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-03a2e95d-ede0-4f9d-ad59-50b7b538f6c0-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:17:59 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4" returned: 0 in 0.516s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:59 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c Jul 17 07:17:59 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Flow 'volume_create_manager' (e7f29226-7654-4cdd-afc8-77d554b239ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc0c5b2-87f0-46ee-97ef-4bfb1f1d56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc0c5b2-87f0-46ee-97ef-4bfb1f1d56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358295724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d013d9c-85c6-4396-9dba-44a1752b5150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede03f3a0c6b451daa8027de7a1c6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:00Z,use_quota=True,user_id='1cd42bb77fc84169a8d2b539dd12dbb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a4ccf3-befb-4c03-a1ef-8db33a2e1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a4ccf3-befb-4c03-a1ef-8db33a2e1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4bdd9b-ad2e-4b6a-85d4-01cc03e0cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4bdd9b-ad2e-4b6a-85d4-01cc03e0cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d013d9c-85c6-4396-9dba-44a1752b5150', 'volume_name': 'volume-7d013d9c-85c6-4396-9dba-44a1752b5150', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac19ff6-419e-4025-89f2-bd56695b0541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac19ff6-419e-4025-89f2-bd56695b0541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40e23d3-e17b-441c-bc8e-48af1b91e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:17:59 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Volume 7d013d9c-85c6-4396-9dba-44a1752b5150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d013d9c-85c6-4396-9dba-44a1752b5150', 'volume_size': 1} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358295724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d013d9c-85c6-4396-9dba-44a1752b5150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede03f3a0c6b451daa8027de7a1c6c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:00Z,use_quota=True,user_id='1cd42bb77fc84169a8d2b539dd12dbb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Creating volume 7d013d9c-85c6-4396-9dba-44a1752b5150 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:17:59 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:17:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:17:59 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 1073741824 Jul 17 07:17:59 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:00 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c" returned: 0 in 0.459s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:00 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c Jul 17 07:18:00 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (2d73f0a3-1988-4c0b-a1f2-f7f2049ad4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd65ba43-f42c-4070-8abb-e44a3defb412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd65ba43-f42c-4070-8abb-e44a3defb412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874331107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c89f7-0b3f-4b2b-a02c-32ec60cbedf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:00Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d77df7-fe2e-4e2c-9cb7-e87386cd8159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d77df7-fe2e-4e2c-9cb7-e87386cd8159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43253d90-d064-44d4-8848-8b9149efc0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43253d90-d064-44d4-8848-8b9149efc0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315c89f7-0b3f-4b2b-a02c-32ec60cbedf0', 'volume_name': 'volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861f9af0-436e-4d49-8900-cc7f84e78ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861f9af0-436e-4d49-8900-cc7f84e78ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06758cd8-d042-478d-a92c-ad84ae5471f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:00 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Volume 315c89f7-0b3f-4b2b-a02c-32ec60cbedf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0', 'volume_size': 1} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:00 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 1073741824" returned: 0 in 0.518s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:00 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4.1846e0a1-1b71-414b-ad76-438d630b003c" returned: 0 in 0.304s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-1846e0a1-1b71-414b-ad76-438d630b003c" released by "_delete_snapshot" :: held 1.951s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-8809c759-261f-4691-a5ae-ff7d74932ca4" released by "delete_snapshot" :: held 2.001s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:00 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 Jul 17 07:18:00 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['78348e24-a96c-41a9-a719-8d28a3bcc426', '5fa42ce6-5279-442e-b2a1-9a6c0d40045f', '82a12f9a-7df6-485a-ae7b-c22658fbab38', 'f2d5d97e-43b6-495b-a429-d1c2b0e2767c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:00 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Delete snapshot completed successfully. Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-55a9c80b-7d06-4d26-9b5c-464a6169a63a tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-1846e0a1-1b71-414b-ad76-438d630b003c-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:00 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874331107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c89f7-0b3f-4b2b-a02c-32ec60cbedf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:00Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Creating volume 315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:00 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40e23d3-e17b-441c-bc8e-48af1b91e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d013d9c-85c6-4396-9dba-44a1752b5150', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:00 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 1073741824 Jul 17 07:18:00 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f073ad-3035-4641-8407-055bfde15e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:00 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Volume volume-7d013d9c-85c6-4396-9dba-44a1752b5150 (7d013d9c-85c6-4396-9dba-44a1752b5150): created successfully Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f073ad-3035-4641-8407-055bfde15e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:00 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Flow 'volume_create_manager' (e7f29226-7654-4cdd-afc8-77d554b239ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:00 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-15a2d4bc-4e7b-4173-934a-1dfdcb8f568a tempest-ProjectReaderTests-1199773133 None] Created volume successfully. Jul 17 07:18:01 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 1073741824" returned: 0 in 0.422s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:01 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 Jul 17 07:18:01 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:01 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" returned: 0 in 0.246s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06758cd8-d042-478d-a92c-ad84ae5471f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6534aa30-5911-4b43-8b40-c95a399da0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:01 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Volume volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 (315c89f7-0b3f-4b2b-a02c-32ec60cbedf0): created successfully Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6534aa30-5911-4b43-8b40-c95a399da0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (2d73f0a3-1988-4c0b-a1f2-f7f2049ad4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:01 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-83fcff90-c1fa-43d3-9f9c-e280c4386296 tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-8809c759-261f-4691-a5ae-ff7d74932ca4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-8809c759-261f-4691-a5ae-ff7d74932ca4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "cinder-quobyte-8809c759-261f-4691-a5ae-ff7d74932ca4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-8809c759-261f-4691-a5ae-ff7d74932ca4" acquired by "delete_volume" :: waited 0.014s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[884107fe-59fd-4f61-81a9-2b3752267f98]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Acquiring lock "cinder-7d013d9c-85c6-4396-9dba-44a1752b5150-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-7d013d9c-85c6-4396-9dba-44a1752b5150-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Acquiring lock "cinder-quobyte-7d013d9c-85c6-4396-9dba-44a1752b5150" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:02 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 Jul 17 07:18:02 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-quobyte-7d013d9c-85c6-4396-9dba-44a1752b5150" acquired by "delete_volume" :: waited 0.028s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e55969-6531-41c6-860d-4818f3ec8f69]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:02 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 Jul 17 07:18:02 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot 635d58fb-49a3-4f34-b9d0-5aebcddf424c of volume 315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:02 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4" returned: 0 in 0.568s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ebdaee-6505-4f17-a978-0d26d55f3ff2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:02 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4 Jul 17 07:18:02 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:02 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 Jul 17 07:18:02 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:02 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150" returned: 0 in 0.553s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:02 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150 Jul 17 07:18:02 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:02 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-8809c759-261f-4691-a5ae-ff7d74932ca4" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-quobyte-8809c759-261f-4691-a5ae-ff7d74932ca4" released by "delete_volume" :: held 1.047s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:02 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" returned: 0 in 0.495s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Created reservations ['367a678a-ed53-4098-ba16-f8e016b513e9', 'abd58136-ac53-4b4e-bca0-d0a0b2483e0b', '903ac214-6384-48cf-b8d6-3646f4c2dc11', 'a5f01726-20c5-43ab-b84f-510e8257b5c5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:02 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-7d013d9c-85c6-4396-9dba-44a1752b5150" returned: 0 in 0.325s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:02 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c 1G Jul 17 07:18:02 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-quobyte-7d013d9c-85c6-4396-9dba-44a1752b5150" released by "delete_volume" :: held 0.940s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Created reservations ['ad273c85-9f41-4ce0-bc8e-3b41f0e9758e', 'ebd97be2-e291-45fe-bf01-3dedeb08b136', '837fda24-1025-4876-9f8c-56da3b21ae09', '7763b23d-7d6e-4a00-a4ac-3d3b3bb60017'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:03 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:03 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:03 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:03 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:03 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.274s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:03 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Deleted volume successfully. Jul 17 07:18:03 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c 1G" returned: 0 in 0.437s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-dea22f4a-9304-46f3-8a81-5e2b87f4109c tempest-CreateVolumesFromSnapshotTest-971958600 None] Lock "cinder-8809c759-261f-4691-a5ae-ff7d74932ca4-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:03 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c Jul 17 07:18:03 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:03 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:03 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Deleted volume successfully. Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-a973196b-2de3-45c4-8a80-f478d6708ad0 tempest-ProjectReaderTests-1199773133 None] Lock "cinder-7d013d9c-85c6-4396-9dba-44a1752b5150-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:03 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c" returned: 0 in 0.291s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:03 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c is being set with open permissions: ugo+rw Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:03 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c Jul 17 07:18:03 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:03 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c" returned: 0 in 0.246s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:03 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info Jul 17 07:18:03 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:04 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info" returned: 0 in 0.337s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:04 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info is being set with open permissions: ugo+rw Jul 17 07:18:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:04 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info Jul 17 07:18:04 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:04 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.info" returned: 0 in 0.321s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:04 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3d4f4b08-29e6-458d-ab00-ac3e970eada8 tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-635d58fb-49a3-4f34-b9d0-5aebcddf424c-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Lock "cinder-635d58fb-49a3-4f34-b9d0-5aebcddf424c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-635d58fb-49a3-4f34-b9d0-5aebcddf424c" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-635d58fb-49a3-4f34-b9d0-5aebcddf424c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot 635d58fb-49a3-4f34-b9d0-5aebcddf424c of volume 315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5afddee-313d-4873-9731-35ec365ed6e8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:05 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c Jul 17 07:18:05 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:06 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c" returned: 0 in 0.483s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b986d6-7662-450a-8de4-104032f2a9dc]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:06 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 Jul 17 07:18:06 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:06 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:06 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c Jul 17 07:18:06 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:07 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c" returned: 0 in 0.432s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:07 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c Jul 17 07:18:07 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:07 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0.635d58fb-49a3-4f34-b9d0-5aebcddf424c" returned: 0 in 0.301s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-635d58fb-49a3-4f34-b9d0-5aebcddf424c" released by "_delete_snapshot" :: held 1.782s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" released by "delete_snapshot" :: held 1.806s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Created reservations ['5f7aee68-0a22-4dbc-90ff-e1bb9405f6aa', '00087ec2-146f-4bb8-9614-74e70bcab153', '44f83107-8d9a-4c27-8d92-6857eecb3c4f', '6aacfdf3-99af-4713-8a52-26140e3581c7'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:07 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-30cfff48-7201-491a-b614-49d7c1a780da tempest-ProjectMemberTests-1934738256 None] Lock "cinder-635d58fb-49a3-4f34-b9d0-5aebcddf424c-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef6bbe-62ba-4939-8334-5f99a7c00192]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:08 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 Jul 17 07:18:08 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:08 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" returned: 0 in 0.484s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:08 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0 Jul 17 07:18:08 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (e10ea49e-c186-46a8-b2a1-e1e17fa7655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b36f7c-4738-48da-bf24-349ac5d2e78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b36f7c-4738-48da-bf24-349ac5d2e78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091516055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23956100-c964-4935-a80c-abfb98ed4e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:09Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbabadd-4517-4f08-b86c-ba7bda566444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbabadd-4517-4f08-b86c-ba7bda566444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da320c4-ca7b-4b91-8991-f5d119f3c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da320c4-ca7b-4b91-8991-f5d119f3c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23956100-c964-4935-a80c-abfb98ed4e4e', 'volume_name': 'volume-23956100-c964-4935-a80c-abfb98ed4e4e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:08 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecac07b6-02c9-4ced-ad9b-8c9f584a5d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecac07b6-02c9-4ced-ad9b-8c9f584a5d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557ba810-a9eb-4e86-9fa6-ea9cc1a716fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume 23956100-c964-4935-a80c-abfb98ed4e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23956100-c964-4935-a80c-abfb98ed4e4e', 'volume_size': 1} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091516055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23956100-c964-4935-a80c-abfb98ed4e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:09Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Creating volume 23956100-c964-4935-a80c-abfb98ed4e4e {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:08 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" returned: 0 in 0.365s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0" released by "delete_volume" :: held 0.933s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:08 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e 1073741824 Jul 17 07:18:08 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:08 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Created reservations ['ff586eaa-167a-4263-8fab-93728cf2fa62', '99afd433-bba4-43d1-8631-c2eddd651c11', '108dfeea-2199-4c1d-a926-64ea91cfc3aa', '906223d3-208f-40b5-97c3-832e908519ee'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:09 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:09 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:09 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:09 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-970a63d6-d911-4072-a97b-9c582d013f51 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-315c89f7-0b3f-4b2b-a02c-32ec60cbedf0-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:09 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e 1073741824" returned: 0 in 0.709s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:SELECT=201,cinder:UPDATE=271,cinder:DELETE=20,cinder:INSERT=79 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:09 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e Jul 17 07:18:09 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=268,cinder:SELECT=210,cinder:INSERT=70,cinder:DELETE=27 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (0d366d0d-a000-46c8-bf63-9a97ad3bf4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464a7d06-b807-4d51-90ec-7c63000a3c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464a7d06-b807-4d51-90ec-7c63000a3c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003601729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:10Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e5d001-d356-42ad-900b-37ef9181062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e5d001-d356-42ad-900b-37ef9181062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e553bf-d5dc-4fed-96be-c56276f672fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e553bf-d5dc-4fed-96be-c56276f672fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f', 'volume_name': 'volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6c604c-d59c-459a-b4a6-15ee365fa233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6c604c-d59c-459a-b4a6-15ee365fa233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c28421-71b1-42e3-ba67-b00a81851137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Volume 6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f', 'volume_size': 1} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:09 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e" returned: 0 in 0.334s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003601729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:10Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Creating volume 6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:09 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557ba810-a9eb-4e86-9fa6-ea9cc1a716fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23956100-c964-4935-a80c-abfb98ed4e4e', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:09 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe3d10c-3e11-42ca-8247-16c0186d91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:09 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f 1073741824 Jul 17 07:18:09 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:09 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume volume-23956100-c964-4935-a80c-abfb98ed4e4e (23956100-c964-4935-a80c-abfb98ed4e4e): created successfully Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe3d10c-3e11-42ca-8247-16c0186d91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (e10ea49e-c186-46a8-b2a1-e1e17fa7655d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6ec35daa-7a95-4d51-847e-29846aa9b746 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created volume successfully. Jul 17 07:18:10 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f 1073741824" returned: 0 in 0.506s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:10 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f Jul 17 07:18:10 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:10 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" returned: 0 in 0.348s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c28421-71b1-42e3-ba67-b00a81851137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84faa750-76cd-4fe7-aa28-d8619a52cfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Volume volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f (6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f): created successfully Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84faa750-76cd-4fe7-aa28-d8619a52cfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (0d366d0d-a000-46c8-bf63-9a97ad3bf4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dcdad374-96de-4c80-ab43-862feb90444b tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (27fa06b5-1a5d-41cf-b87f-3ceefa1c647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b23ab10-664c-4c2d-bca7-00f5797bd910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b23ab10-664c-4c2d-bca7-00f5797bd910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60465182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a8823f-ec08-45a5-bb6c-55ed42c50f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:11Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c95d99-83a0-44ea-af47-6473f59b8948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c95d99-83a0-44ea-af47-6473f59b8948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9bcccc-a8b0-4199-bf8c-fda39b26f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9bcccc-a8b0-4199-bf8c-fda39b26f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a8823f-ec08-45a5-bb6c-55ed42c50f31', 'volume_name': 'volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79032e8-ff0a-44e0-81a8-76d9d3d27e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79032e8-ff0a-44e0-81a8-76d9d3d27e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77fb28a-c81d-4234-b1b3-78cb6fae8653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:11 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume 50a8823f-ec08-45a5-bb6c-55ed42c50f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31', 'volume_size': 1} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60465182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a8823f-ec08-45a5-bb6c-55ed42c50f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:11Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Creating volume 50a8823f-ec08-45a5-bb6c-55ed42c50f31 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:11 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:11 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 1073741824 Jul 17 07:18:11 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (2c21f4cd-f6d4-44f9-aaf1-20dbf3acf2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5668f4bc-4f25-446b-9d11-30f8bef3a6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5668f4bc-4f25-446b-9d11-30f8bef3a6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575793701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dd1f19-ac74-4d37-a5be-d77ab5b9e087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:12Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0db8d0-57b1-4d16-bd42-e21303f76164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0db8d0-57b1-4d16-bd42-e21303f76164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2d5196-bab9-4530-985d-5ab7d496d73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2d5196-bab9-4530-985d-5ab7d496d73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82dd1f19-ac74-4d37-a5be-d77ab5b9e087', 'volume_name': 'volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876c8cdd-32d1-4952-8197-bc8909cce4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876c8cdd-32d1-4952-8197-bc8909cce4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0653e2-1b0d-4c2c-9186-8355ed70a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume 82dd1f19-ac74-4d37-a5be-d77ab5b9e087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087', 'volume_size': 1} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:12 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 1073741824" returned: 0 in 0.974s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:12 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 Jul 17 07:18:12 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (668fb4cb-b515-49dd-bcd9-e2ac5b4e323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb37f4bc-6299-4895-8636-1c153774fc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb37f4bc-6299-4895-8636-1c153774fc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-615898753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e55d334-bdc0-4ad6-b210-58cb2d003bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:13Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53235a2a-c1f7-4c89-b131-68128a70c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53235a2a-c1f7-4c89-b131-68128a70c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd9c742-947e-46f2-8cb9-f267cc909139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd9c742-947e-46f2-8cb9-f267cc909139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e55d334-bdc0-4ad6-b210-58cb2d003bd4', 'volume_name': 'volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6cbb07-d880-4769-9fe3-e429e8afc7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6cbb07-d880-4769-9fe3-e429e8afc7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25216cb4-62bf-43ae-9f3e-56677afae421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume 9e55d334-bdc0-4ad6-b210-58cb2d003bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4', 'volume_size': 1} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:12 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31" returned: 0 in 0.365s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575793701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dd1f19-ac74-4d37-a5be-d77ab5b9e087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:12Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Creating volume 82dd1f19-ac74-4d37-a5be-d77ab5b9e087 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:12 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77fb28a-c81d-4234-b1b3-78cb6fae8653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f8827-6a6b-4440-aff2-efbf3941b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:12 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 1073741824 Jul 17 07:18:12 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:12 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 (50a8823f-ec08-45a5-bb6c-55ed42c50f31): created successfully Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f8827-6a6b-4440-aff2-efbf3941b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:12 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (27fa06b5-1a5d-41cf-b87f-3ceefa1c647f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:13 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-41678c6c-57c1-446e-99c3-c32c9c52ad8e tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created volume successfully. Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (65a05a8c-86a6-4087-abdc-115984bb8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17008b0d-9bcf-4686-8695-c33dbf9def70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17008b0d-9bcf-4686-8695-c33dbf9def70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1656818230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c0fcac-631a-4177-a38c-527324a10d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:13Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28c69f2-679d-408e-aac0-67eb481a22dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28c69f2-679d-408e-aac0-67eb481a22dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b651f3-8148-4947-a53f-c7fa204fbdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b651f3-8148-4947-a53f-c7fa204fbdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c0fcac-631a-4177-a38c-527324a10d44', 'volume_name': 'volume-45c0fcac-631a-4177-a38c-527324a10d44', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f08742c-e900-4ec9-9a38-ac342f81b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f08742c-e900-4ec9-9a38-ac342f81b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a011849-5ab1-45fb-8e59-8280a6bff8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume 45c0fcac-631a-4177-a38c-527324a10d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c0fcac-631a-4177-a38c-527324a10d44', 'volume_size': 1} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:13 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 1073741824" returned: 0 in 0.667s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (61258e1c-47d4-489a-bf83-202192aee45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42171cc-c43a-4753-9aa8-b9e05ceccbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42171cc-c43a-4753-9aa8-b9e05ceccbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870990858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c82c2-d61b-4aff-aac8-1061b8dc64d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:14Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 Jul 17 07:18:13 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6360c071-ab1a-438e-b985-43ed5041433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6360c071-ab1a-438e-b985-43ed5041433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd97fd31-607c-48da-8a50-c10ed359d466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd97fd31-607c-48da-8a50-c10ed359d466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8c82c2-d61b-4aff-aac8-1061b8dc64d9', 'volume_name': 'volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51a792c-4133-443b-81ae-2629e0128370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51a792c-4133-443b-81ae-2629e0128370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b9ec9-f366-4773-a2e2-66a026c76a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:13 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume 5e8c82c2-d61b-4aff-aac8-1061b8dc64d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9', 'volume_size': 1} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:13 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087" returned: 0 in 0.246s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.545s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0653e2-1b0d-4c2c-9186-8355ed70a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:13 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db265f3-6bad-4f3b-8530-8deaffc913b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot 25cfa922-7444-4b93-a477-2c456a77a837 of volume 6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:14 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 (82dd1f19-ac74-4d37-a5be-d77ab5b9e087): created successfully Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db265f3-6bad-4f3b-8530-8deaffc913b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (2c21f4cd-f6d4-44f9-aaf1-20dbf3acf2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[170811ad-e55e-4af1-a9e6-456842e99697]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f08266e8-6b70-438f-bf7e-67aa549b4292 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created volume successfully. Jul 17 07:18:14 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f Jul 17 07:18:14 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:14 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" returned: 0 in 0.413s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:14 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 1G Jul 17 07:18:14 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:14 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 1G" returned: 0 in 0.419s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:14 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 Jul 17 07:18:14 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:15 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:15 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 is being set with open permissions: ugo+rw Jul 17 07:18:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:15 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 Jul 17 07:18:15 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:15 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:15 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info Jul 17 07:18:15 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:15 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:15 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info is being set with open permissions: ugo+rw Jul 17 07:18:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:15 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info Jul 17 07:18:15 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:16 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.info" returned: 0 in 0.256s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.279s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-615898753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e55d334-bdc0-4ad6-b210-58cb2d003bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:13Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Creating volume 9e55d334-bdc0-4ad6-b210-58cb2d003bd4 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:16 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:16 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 1073741824 Jul 17 07:18:16 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:16 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-08189fcf-3845-45f0-9a12-5d7528cfde03 tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-25cfa922-7444-4b93-a477-2c456a77a837-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-25cfa922-7444-4b93-a477-2c456a77a837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-25cfa922-7444-4b93-a477-2c456a77a837" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-25cfa922-7444-4b93-a477-2c456a77a837" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot 25cfa922-7444-4b93-a477-2c456a77a837 of volume 6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ffc395-6a95-44d5-860d-e99f1093af14]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:16 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 1073741824" returned: 0 in 0.544s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:16 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 Jul 17 07:18:16 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:16 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 Jul 17 07:18:16 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:17 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1656818230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c0fcac-631a-4177-a38c-527324a10d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:13Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Creating volume 45c0fcac-631a-4177-a38c-527324a10d44 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:17 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:17 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25216cb4-62bf-43ae-9f3e-56677afae421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb67efaf-ed00-475b-a2dd-f5df3aef7639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:17 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 1073741824 Jul 17 07:18:17 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837" returned: 0 in 0.424s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:17 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 (9e55d334-bdc0-4ad6-b210-58cb2d003bd4): created successfully Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb67efaf-ed00-475b-a2dd-f5df3aef7639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (668fb4cb-b515-49dd-bcd9-e2ac5b4e323c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05fc4a5-9ea6-4f7f-87b5-56222427195d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1f0e5d84-05d7-4fbd-a241-57b4499a1397 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created volume successfully. Jul 17 07:18:17 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f Jul 17 07:18:17 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:17 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:17 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 1073741824" returned: 0 in 0.546s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" returned: 0 in 0.453s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:17 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 Jul 17 07:18:17 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:17 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 Jul 17 07:18:17 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:17 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.235s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870990858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c82c2-d61b-4aff-aac8-1061b8dc64d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf28f3b6714afbbaa5927bc13a2cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:14Z,use_quota=True,user_id='bd90401d14d348519f4e791925b55453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Creating volume 5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:17 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:17 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a011849-5ab1-45fb-8e59-8280a6bff8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c0fcac-631a-4177-a38c-527324a10d44', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d09e43-85ce-4a03-ae82-bf1c082509c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:18 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 1073741824 Jul 17 07:18:18 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume volume-45c0fcac-631a-4177-a38c-527324a10d44 (45c0fcac-631a-4177-a38c-527324a10d44): created successfully Jul 17 07:18:18 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d09e43-85ce-4a03-ae82-bf1c082509c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (65a05a8c-86a6-4087-abdc-115984bb8205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837" returned: 0 in 0.462s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-940793d6-bc55-429f-b868-997f59561cf9 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created volume successfully. Jul 17 07:18:18 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837 Jul 17 07:18:18 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:18 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f.25cfa922-7444-4b93-a477-2c456a77a837" returned: 0 in 0.341s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-25cfa922-7444-4b93-a477-2c456a77a837" released by "_delete_snapshot" :: held 1.820s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" released by "delete_snapshot" :: held 1.849s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:18 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 1073741824" returned: 0 in 0.521s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Created reservations ['0e79b718-b4f3-40f2-9c34-d5d122686372', '482bc83f-d599-4d2c-8d90-910c0d2582bf', '4a60134c-ecef-4e54-b2cb-53202e15e3ec', '0b62e760-55b9-4992-9a9c-9283023959f9'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:18 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 Jul 17 07:18:18 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-079346bc-62cf-4e73-89ba-4cc2ecb4a50d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-25cfa922-7444-4b93-a477-2c456a77a837-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:18 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9" returned: 0 in 0.366s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b9ec9-f366-4773-a2e2-66a026c76a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e109891f-507b-4a1f-9b77-f0ada49a07ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e3aa3c-3579-4118-8f52-f3d3a659c27b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:18 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Volume volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 (5e8c82c2-d61b-4aff-aac8-1061b8dc64d9): created successfully Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e109891f-507b-4a1f-9b77-f0ada49a07ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:18 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Flow 'volume_create_manager' (61258e1c-47d4-489a-bf83-202192aee45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-010b10ca-e339-4649-a9b5-8e81a32901f7 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created volume successfully. Jul 17 07:18:19 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f Jul 17 07:18:19 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-quobyte-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06fa0bc-13a3-4877-96cf-1c982e7aa6cd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:19 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:19 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f Jul 17 07:18:19 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:19 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 Jul 17 07:18:19 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:19 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" returned: 0 in 0.285s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f" released by "delete_volume" :: held 0.841s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:19 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9" returned: 0 in 0.436s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Created reservations ['addc3c36-4110-4703-8497-561c474f7178', '6204cc2a-984a-41ea-b8df-9534f13c3b49', 'b86304b3-ce0e-452e-8b1e-8f8779109085', '393dc3e4-a07a-4f0f-98bb-129c37513ec8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:19 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9 Jul 17 07:18:19 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:19 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:19 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:20 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9" returned: 0 in 0.311s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9" released by "delete_volume" :: held 0.797s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created reservations ['5d04f57a-a6f3-4824-a899-f5891410c7f2', 'c1b65fc1-d58e-4be9-a07e-7716938513af', 'cd98d239-2583-4a4a-b760-e06010ae3d74', '9190fdae-a308-497d-b521-4f745898a23d'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:20 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.361s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-eca7c10d-c4de-4e1a-85a7-c8fdbd53bc86 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-6d073c8e-ef3b-448f-8a80-dd1eea2e3c8f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:20 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:20 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-45c0fcac-631a-4177-a38c-527324a10d44-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-45c0fcac-631a-4177-a38c-527324a10d44-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-quobyte-45c0fcac-631a-4177-a38c-527324a10d44" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (55e78ee8-bd0d-4536-a660-989f8b11e8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feca02d5-c9ce-422d-8fae-88c9484e20d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-45c0fcac-631a-4177-a38c-527324a10d44" acquired by "delete_volume" :: waited 0.063s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[92765875-a48f-42ee-992a-2068a36a6e07]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:20 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feca02d5-c9ce-422d-8fae-88c9484e20d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920055848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d27ec7c-1fcc-4c21-b890-d4061048ff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:20Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aebcb77-3128-4dfc-ada8-bd4c09f30fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aebcb77-3128-4dfc-ada8-bd4c09f30fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aadc885-04e8-45e9-b08d-b733787c22b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aadc885-04e8-45e9-b08d-b733787c22b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d27ec7c-1fcc-4c21-b890-d4061048ff94', 'volume_name': 'volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68aff72-ad20-4ebd-95fc-1419e572dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68aff72-ad20-4ebd-95fc-1419e572dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e68b912-b248-4dd9-b545-f4eaea9c962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:20 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Volume 3d27ec7c-1fcc-4c21-b890-d4061048ff94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94', 'volume_size': 1} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920055848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d27ec7c-1fcc-4c21-b890-d4061048ff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:20Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Creating volume 3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:20 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Deleted volume successfully. Jul 17 07:18:20 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 1073741824 Jul 17 07:18:20 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:20 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 Jul 17 07:18:20 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-84784bfd-0d17-416b-9f0a-8719251dcf1a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-5e8c82c2-d61b-4aff-aac8-1061b8dc64d9-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:21 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44" returned: 0 in 0.395s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:21 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44 Jul 17 07:18:21 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:21 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 1073741824" returned: 0 in 0.494s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:21 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 Jul 17 07:18:21 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:21 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-45c0fcac-631a-4177-a38c-527324a10d44" returned: 0 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-45c0fcac-631a-4177-a38c-527324a10d44" released by "delete_volume" :: held 0.830s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created reservations ['a3bd53fc-1879-4ace-b755-84f643dd7ad2', '4379c16b-9bbb-4554-bfad-53d4e140ae95', '6023bee6-2f3f-4b82-b8bf-9a57da976831', 'ebeecc21-3e05-4d32-be4a-cf096487da89'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:21 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:21 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:21 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-9e55d334-bdc0-4ad6-b210-58cb2d003bd4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e68b912-b248-4dd9-b545-f4eaea9c962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67293139-e573-4760-9551-1d42d3bb2d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-9e55d334-bdc0-4ad6-b210-58cb2d003bd4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:21 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Volume volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 (3d27ec7c-1fcc-4c21-b890-d4061048ff94): created successfully Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67293139-e573-4760-9551-1d42d3bb2d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (55e78ee8-bd0d-4536-a660-989f8b11e8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-42d65931-8f0c-493d-8940-8410690e2051 tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-quobyte-9e55d334-bdc0-4ad6-b210-58cb2d003bd4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-9e55d334-bdc0-4ad6-b210-58cb2d003bd4" acquired by "delete_volume" :: waited 0.044s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:21 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.292s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:21 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Deleted volume successfully. Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5117e42-8ed9-4809-86dc-3c70f79f2f5e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-977808e3-ef85-456a-ab3a-51294b30769a tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-45c0fcac-631a-4177-a38c-527324a10d44-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:22 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 Jul 17 07:18:22 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:22 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:22 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4 Jul 17 07:18:22 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:22 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9e55d334-bdc0-4ad6-b210-58cb2d003bd4" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-9e55d334-bdc0-4ad6-b210-58cb2d003bd4" released by "delete_volume" :: held 0.736s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created reservations ['67863a90-c8b1-4524-a1fe-eda792dec239', '8c7d3626-cad2-43d8-a75a-ecd98afd9f52', 'b75e4829-b11e-493e-95dc-6c27fefbe212', '7d9f6c54-818e-45b0-a632-cd9277fe8833'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:22 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:22 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot 0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 of volume 3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5788af54-2a5e-485c-8e45-7344f3015e0b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-82dd1f19-ac74-4d37-a5be-d77ab5b9e087-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-82dd1f19-ac74-4d37-a5be-d77ab5b9e087-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:23 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 Jul 17 07:18:23 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:23 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.318s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:23 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Deleted volume successfully. Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-quobyte-82dd1f19-ac74-4d37-a5be-d77ab5b9e087" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4ae79cc0-4930-4224-88fa-20a409f56693 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-9e55d334-bdc0-4ad6-b210-58cb2d003bd4-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-82dd1f19-ac74-4d37-a5be-d77ab5b9e087" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfef476-8625-46c1-8d03-6cd8d63c4da4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:23 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 Jul 17 07:18:23 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:23 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94" returned: 0 in 0.517s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:23 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 1G Jul 17 07:18:23 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:23 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:23 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087 Jul 17 07:18:23 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:23 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 1G" returned: 0 in 0.502s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:23 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-82dd1f19-ac74-4d37-a5be-d77ab5b9e087" returned: 0 in 0.292s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:23 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 Jul 17 07:18:23 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-82dd1f19-ac74-4d37-a5be-d77ab5b9e087" released by "delete_volume" :: held 0.787s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:23 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created reservations ['ce8d0002-fe55-4e78-895f-aa6ea6632840', '0890844d-98aa-4bc7-adbd-d305d242b0b2', '027fa345-3c22-4514-b292-4d2acb310281', 'e4698a6d-ed81-44fd-bed2-bc952f3ccf79'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:24 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:24 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-50a8823f-ec08-45a5-bb6c-55ed42c50f31-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-50a8823f-ec08-45a5-bb6c-55ed42c50f31-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:24 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:24 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 is being set with open permissions: ugo+rw Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:24 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 Jul 17 07:18:24 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-quobyte-50a8823f-ec08-45a5-bb6c-55ed42c50f31" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-50a8823f-ec08-45a5-bb6c-55ed42c50f31" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb644c8-0b3e-46cf-ba06-f0d971db16a4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:24 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.366s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:24 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Deleted volume successfully. Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-b785aa13-972c-4839-868d-ca52ab598b82 tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-82dd1f19-ac74-4d37-a5be-d77ab5b9e087-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:24 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 Jul 17 07:18:24 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:24 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" returned: 0 in 0.307s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:24 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info Jul 17 07:18:24 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:24 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31" returned: 0 in 0.434s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:24 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31 Jul 17 07:18:24 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:24 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:24 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info is being set with open permissions: ugo+rw Jul 17 07:18:24 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:24 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info Jul 17 07:18:24 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:25 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-50a8823f-ec08-45a5-bb6c-55ed42c50f31" returned: 0 in 0.294s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-50a8823f-ec08-45a5-bb6c-55ed42c50f31" released by "delete_volume" :: held 0.779s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created reservations ['7e75a651-a501-4681-8510-7c05ac04c8f8', 'ff2b0538-4e4b-408b-a611-07aa22b7fecf', '6b89177e-6c90-410e-a306-5dc0d39dc781', 'e3741aa1-16de-47dd-a86d-654a88549494'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:25 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.info" returned: 0 in 0.286s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-14520c91-5813-430f-ba46-6d1f73293d2e tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:25 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:25 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-23956100-c964-4935-a80c-abfb98ed4e4e-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-23956100-c964-4935-a80c-abfb98ed4e4e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "cinder-quobyte-23956100-c964-4935-a80c-abfb98ed4e4e" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-23956100-c964-4935-a80c-abfb98ed4e4e" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8e21c-006f-4b5c-bca6-b858c4340424]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:25 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:25 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Deleted volume successfully. Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-50ccdb54-482f-4914-a902-c8015a0a757d tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-50a8823f-ec08-45a5-bb6c-55ed42c50f31-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:25 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e Jul 17 07:18:25 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:25 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e" returned: 0 in 0.409s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:25 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-0fb2cf98-6e26-4b40-8de8-56ad1657f6a5-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:25 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e Jul 17 07:18:25 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-0fb2cf98-6e26-4b40-8de8-56ad1657f6a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-3d27ec7c-1fcc-4c21-b890-d4061048ff94" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3d27ec7c-1fcc-4c21-b890-d4061048ff94" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot 0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 of volume 3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14aeb9f-06e7-4ed0-a973-88fd4d645a0f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:26 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 Jul 17 07:18:26 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:26 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-23956100-c964-4935-a80c-abfb98ed4e4e" returned: 0 in 0.277s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-quobyte-23956100-c964-4935-a80c-abfb98ed4e4e" released by "delete_volume" :: held 0.758s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Created reservations ['0d6d601a-e534-4fb4-b7cf-22201c080084', 'ad513b15-5b5b-4e61-8631-e83d048705cf', 'a1181799-1b58-4080-af51-0f1f31544ee8', '8dd6aef5-9827-495e-a964-5878a4864f74'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:26 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:26 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:26 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e8b254-836d-4e1d-8602-a2d2129144f3]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:26 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 Jul 17 07:18:26 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:26 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.318s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:26 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Deleted volume successfully. Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2cac1da-c00c-491a-96b5-e0de00fe02dc tempest-CreateVolumesFromSourceVolumeTest-810931781 None] Lock "cinder-23956100-c964-4935-a80c-abfb98ed4e4e-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:26 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:26 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:27 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 Jul 17 07:18:27 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:27 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" returned: 0 in 0.377s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:27 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5 Jul 17 07:18:27 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:27 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94.0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" returned: 0 in 0.380s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-0fb2cf98-6e26-4b40-8de8-56ad1657f6a5" released by "_delete_snapshot" :: held 1.743s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3d27ec7c-1fcc-4c21-b890-d4061048ff94" released by "delete_snapshot" :: held 1.770s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Created reservations ['0ef16d6b-1b94-42c5-a4e1-3cbe3d358cd1', '37cf9a66-7b2d-4a05-8fd1-34d2fd84fa6a', '311e79a9-dd23-4a2a-8f02-0878a8900e5f', '024ec37d-c61c-4a60-9871-e31443ac463f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:27 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:18:27 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-18447f58-f31d-40be-9dd3-53d67e25f085 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-0fb2cf98-6e26-4b40-8de8-56ad1657f6a5-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-3d27ec7c-1fcc-4c21-b890-d4061048ff94-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-3d27ec7c-1fcc-4c21-b890-d4061048ff94-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-3d27ec7c-1fcc-4c21-b890-d4061048ff94" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3d27ec7c-1fcc-4c21-b890-d4061048ff94" acquired by "delete_volume" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db87876-37c4-4be7-b1f0-f358843d8783]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:28 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 Jul 17 07:18:28 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:28 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94" returned: 0 in 0.442s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:28 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94 Jul 17 07:18:28 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:29 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3d27ec7c-1fcc-4c21-b890-d4061048ff94" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3d27ec7c-1fcc-4c21-b890-d4061048ff94" released by "delete_volume" :: held 0.771s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Created reservations ['581c71fa-07ce-401b-9ba3-40e5b3f282c4', 'e2724e05-5479-4951-abd1-8871d06ab707', '163bbf69-06b4-40bf-8e0d-05eedd27d94d', '30aae4ae-0bcc-4c99-acb5-7e741910eacc'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:29 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:29 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:29 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.340s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:29 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-47efdf88-e34c-4fdb-bd33-867f8706f928 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-3d27ec7c-1fcc-4c21-b890-d4061048ff94-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:29 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:29 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (6483d765-3db5-4784-b7ed-e4f0957a953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cb55ae-9a7e-4f1f-a71b-9871da6707ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cb55ae-9a7e-4f1f-a71b-9871da6707ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324917231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909d0eb2-cc14-4346-831a-6d568d185c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:30Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135e4c95-46db-4e16-a117-e09cabfc2845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135e4c95-46db-4e16-a117-e09cabfc2845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b704e2-f183-4081-b250-968bab76a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b704e2-f183-4081-b250-968bab76a580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909d0eb2-cc14-4346-831a-6d568d185c15', 'volume_name': 'volume-909d0eb2-cc14-4346-831a-6d568d185c15', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188a067d-8be0-4cb4-8dba-d3eef90891fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188a067d-8be0-4cb4-8dba-d3eef90891fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f90816-af68-48fb-8fa7-c6ab25a43a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:30 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Volume 909d0eb2-cc14-4346-831a-6d568d185c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909d0eb2-cc14-4346-831a-6d568d185c15', 'volume_size': 1} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324917231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909d0eb2-cc14-4346-831a-6d568d185c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:30Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Creating volume 909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:30 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:30 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 1073741824 Jul 17 07:18:30 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:30 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.413s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:18:30 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 1073741824" returned: 0 in 0.604s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:30 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 Jul 17 07:18:30 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:31 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15" returned: 0 in 0.335s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f90816-af68-48fb-8fa7-c6ab25a43a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909d0eb2-cc14-4346-831a-6d568d185c15', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d16751-8e12-4fd1-80f5-c6c0640aeec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:31 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Volume volume-909d0eb2-cc14-4346-831a-6d568d185c15 (909d0eb2-cc14-4346-831a-6d568d185c15): created successfully Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d16751-8e12-4fd1-80f5-c6c0640aeec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (6483d765-3db5-4784-b7ed-e4f0957a953c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4c9e11c4-3a06-4a5a-bb6a-0acca75049a5 tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (7861ad52-d370-4c80-961a-ea45524d4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293dc99f-5ac8-4aa3-b2fc-ca62a5ddeade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot c886c189-9d37-4b46-a6af-b6d3e30875cc of volume 909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293dc99f-5ac8-4aa3-b2fc-ca62a5ddeade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442646373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad917cc3-d87b-4fe0-b9bd-8163a7fc5114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:33Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f551cb8d-c6cf-4393-9bd2-1a6b5b2ab6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f551cb8d-c6cf-4393-9bd2-1a6b5b2ab6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83384521-e6fa-4d85-aaca-2541b30dff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83384521-e6fa-4d85-aaca-2541b30dff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad917cc3-d87b-4fe0-b9bd-8163a7fc5114', 'volume_name': 'volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0a409c-e09b-421f-9207-c5bf9725e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0a409c-e09b-421f-9207-c5bf9725e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d1c300-3d5e-4528-b783-b2c8023c795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:32 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Volume ad917cc3-d87b-4fe0-b9bd-8163a7fc5114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114', 'volume_size': 1} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673b1df-7ecd-413f-8f38-c9f2932dfb08]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:32 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 Jul 17 07:18:32 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:33 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15" returned: 0 in 0.447s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:33 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc 1G Jul 17 07:18:33 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Flow 'volume_create_manager' (0410341f-d8a5-40ac-a31d-844e5667d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b19e672-acf5-4742-941a-60faea5dcaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b19e672-acf5-4742-941a-60faea5dcaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1431031786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcad491-8a1a-4f7e-9b1d-ec063e59f59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2aba9021ba40348c3bd0af5bff03cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:33Z,use_quota=True,user_id='8d0f655b84254d848dfd9a398220b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a9747c-51f5-4fd9-9469-97cc5c6a5f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a9747c-51f5-4fd9-9469-97cc5c6a5f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0258cc8-9f29-4d10-b93e-8822a8708304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0258cc8-9f29-4d10-b93e-8822a8708304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcad491-8a1a-4f7e-9b1d-ec063e59f59b', 'volume_name': 'volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa61463-791f-4669-a9d8-c6db5bcad394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa61463-791f-4669-a9d8-c6db5bcad394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e576d147-d6c2-4354-8cf3-c430a26555f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:33 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Volume 4bcad491-8a1a-4f7e-9b1d-ec063e59f59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b', 'volume_size': 1} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:33 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc 1G" returned: 0 in 0.457s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909d0eb2-cc14-4346-831a-6d568d185c15 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:33 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909d0eb2-cc14-4346-831a-6d568d185c15 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc Jul 17 07:18:33 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:33 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909d0eb2-cc14-4346-831a-6d568d185c15 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:33 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc is being set with open permissions: ugo+rw Jul 17 07:18:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:33 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc Jul 17 07:18:33 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:34 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc" returned: 0 in 0.238s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:34 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info Jul 17 07:18:34 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:34 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info" returned: 0 in 0.249s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:34 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info is being set with open permissions: ugo+rw Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:34 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info Jul 17 07:18:34 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:34 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.info" returned: 0 in 0.235s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442646373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad917cc3-d87b-4fe0-b9bd-8163a7fc5114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:33Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Creating volume ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:34 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:34 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 1073741824 Jul 17 07:18:34 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-543929d8-dda8-4fd4-b4e2-ca04c3ac2281 tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:18:35 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 1073741824" returned: 0 in 0.423s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:35 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 Jul 17 07:18:35 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:35 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" returned: 0 in 0.237s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1431031786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcad491-8a1a-4f7e-9b1d-ec063e59f59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2aba9021ba40348c3bd0af5bff03cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:33Z,use_quota=True,user_id='8d0f655b84254d848dfd9a398220b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Creating volume 4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:35 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d1c300-3d5e-4528-b783-b2c8023c795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:35 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b 1073741824 Jul 17 07:18:35 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f04ce1c-1cc5-4b01-ab91-8a7989edbc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:35 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Volume volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 (ad917cc3-d87b-4fe0-b9bd-8163a7fc5114): created successfully Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f04ce1c-1cc5-4b01-ab91-8a7989edbc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (7861ad52-d370-4c80-961a-ea45524d4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:35 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-b64d7d47-af80-48ba-b749-eb7548aad3f6 tempest-ProjectReaderTests-1617595905 None] Created volume successfully. Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-c886c189-9d37-4b46-a6af-b6d3e30875cc-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-c886c189-9d37-4b46-a6af-b6d3e30875cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-909d0eb2-cc14-4346-831a-6d568d185c15" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-909d0eb2-cc14-4346-831a-6d568d185c15" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-c886c189-9d37-4b46-a6af-b6d3e30875cc" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-c886c189-9d37-4b46-a6af-b6d3e30875cc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot c886c189-9d37-4b46-a6af-b6d3e30875cc of volume 909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[243456c0-8a46-4a01-aeb5-efe268549cde]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:35 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc Jul 17 07:18:35 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:35 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b 1073741824" returned: 0 in 0.511s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:35 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:35 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:36 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909d0eb2-cc14-4346-831a-6d568d185c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b00d8-5b2f-48ac-af42-4bdbf2da3c17]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:36 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.354s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:36 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 Jul 17 07:18:36 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Creating offline snapshot 45fd8dfa-1521-41d8-8d6a-b187d6721cdb of volume ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e576d147-d6c2-4354-8cf3-c430a26555f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694da6f-3a66-4919-b6c8-582052bbe915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7510909f-cdf2-434c-ac35-429a73e68160]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:36 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Volume volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b (4bcad491-8a1a-4f7e-9b1d-ec063e59f59b): created successfully Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694da6f-3a66-4919-b6c8-582052bbe915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Flow 'volume_create_manager' (0410341f-d8a5-40ac-a31d-844e5667d35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-dfff2f13-9166-4e68-abf0-c69afea8ef86 tempest-SnapshotDependencyTests-502188959 None] Created volume successfully. Jul 17 07:18:36 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 Jul 17 07:18:36 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:36 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15" returned: 0 in 0.369s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:36 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc Jul 17 07:18:36 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:36 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" returned: 0 in 0.385s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:36 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb 1G Jul 17 07:18:36 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:36 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc" returned: 0 in 0.417s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:36 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc Jul 17 07:18:36 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:37 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb 1G" returned: 0 in 0.392s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:37 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb Jul 17 07:18:37 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:37 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15.c886c189-9d37-4b46-a6af-b6d3e30875cc" returned: 0 in 0.263s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-c886c189-9d37-4b46-a6af-b6d3e30875cc" released by "_delete_snapshot" :: held 1.531s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-909d0eb2-cc14-4346-831a-6d568d185c15" released by "delete_snapshot" :: held 1.557s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Created reservations ['bcd0d0c4-e74b-4221-9cc2-3be74a3d8418', '755b08d2-f3fc-42d3-bc24-2b7cc2054758', 'c6d8d6f5-ca99-4d47-93c0-cd4f13cac1ad', 'bb971919-972f-4175-a044-9236a173207f'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:37 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee4878d8-3523-4ecb-92b8-417baf41637d tempest-ProjectMemberTests-1934738256 None] Lock "cinder-c886c189-9d37-4b46-a6af-b6d3e30875cc-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:37 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb" returned: 0 in 0.309s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:37 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb is being set with open permissions: ugo+rw Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:37 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb Jul 17 07:18:37 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:37 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb" returned: 0 in 0.245s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:37 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info Jul 17 07:18:37 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-909d0eb2-cc14-4346-831a-6d568d185c15-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-909d0eb2-cc14-4346-831a-6d568d185c15-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-909d0eb2-cc14-4346-831a-6d568d185c15" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-909d0eb2-cc14-4346-831a-6d568d185c15" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:37 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info" returned: 0 in 0.277s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:37 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info is being set with open permissions: ugo+rw Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e69a33-2d82-4f42-9e12-af44fe6a6faa]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:37 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info Jul 17 07:18:37 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:38 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 Jul 17 07:18:38 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:38 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.info" returned: 0 in 0.252s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.282s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Creating offline snapshot 08f394c8-0b4a-4e43-8345-8260415734cf of volume 4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f85db-0395-4b8c-96bd-b3622288e302]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-40d6cbe3-a491-4cc9-b3fe-9033df4bcb14 tempest-ProjectReaderTests-1617595905 None] Create snapshot completed successfully Jul 17 07:18:38 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15" returned: 0 in 0.370s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:38 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15 Jul 17 07:18:38 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:38 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:38 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:38 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-909d0eb2-cc14-4346-831a-6d568d185c15" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-909d0eb2-cc14-4346-831a-6d568d185c15" released by "delete_volume" :: held 0.697s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:38 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.367s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:38 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf 1G Jul 17 07:18:38 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Created reservations ['ab57f357-afc4-4987-ba2d-c2e6a50f58ed', '301e99fe-2454-4be1-a61d-dc63879aca36', 'f9638b4d-d392-475c-bf4e-a95c691cbc41', '1afb8a21-a699-4c83-800d-3b8376e51480'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:38 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:38 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:38 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.260s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:18:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c8133086-6a58-40dc-ba69-54c12449d734 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-909d0eb2-cc14-4346-831a-6d568d185c15-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:39 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf 1G" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:39 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf Jul 17 07:18:39 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-45fd8dfa-1521-41d8-8d6a-b187d6721cdb-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-45fd8dfa-1521-41d8-8d6a-b187d6721cdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-45fd8dfa-1521-41d8-8d6a-b187d6721cdb" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-45fd8dfa-1521-41d8-8d6a-b187d6721cdb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Deleting offline snapshot 45fd8dfa-1521-41d8-8d6a-b187d6721cdb of volume ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] snapshot_file for this snap is: volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b945162-a5cd-41bd-a19f-0aeb7d471e39]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:39 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:39 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf is being set with open permissions: ugo+rw Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:39 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf Jul 17 07:18:39 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (754c4e68-d53d-4cbc-8754-04542bfe07f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1da020-3797-4340-9e4e-193297656497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1da020-3797-4340-9e4e-193297656497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719154999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e07ca3-8d46-49e9-8fdb-aef138ef5f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:39Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:39 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb Jul 17 07:18:39 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b3fa2c-7e7e-4e09-b53b-619b944d0d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b3fa2c-7e7e-4e09-b53b-619b944d0d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870ca25d-db19-4c5c-b478-d31c948d93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870ca25d-db19-4c5c-b478-d31c948d93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e07ca3-8d46-49e9-8fdb-aef138ef5f7f', 'volume_name': 'volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8ca1e9-6030-4c4c-b842-3373ba06b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8ca1e9-6030-4c4c-b842-3373ba06b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea10bd3-3158-4c6f-a304-02180b247f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Volume 08e07ca3-8d46-49e9-8fdb-aef138ef5f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f', 'volume_size': 1} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:39 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:39 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info Jul 17 07:18:39 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:39 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb" returned: 0 in 0.379s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[66324ade-ea2e-4ced-b197-c1db760f1382]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:39 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 Jul 17 07:18:39 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:39 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:39 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info is being set with open permissions: ugo+rw Jul 17 07:18:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:39 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info Jul 17 07:18:39 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:40 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" returned: 0 in 0.357s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:40 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb Jul 17 07:18:40 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:40 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.info" returned: 0 in 0.251s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719154999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e07ca3-8d46-49e9-8fdb-aef138ef5f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:39Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Creating volume 08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:40 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:40 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f 1073741824 Jul 17 07:18:40 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ca87377d-2f3f-41cc-851d-9c1e46820605 tempest-SnapshotDependencyTests-502188959 None] Create snapshot completed successfully Jul 17 07:18:40 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb" returned: 0 in 0.350s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:40 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb Jul 17 07:18:40 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:40 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f 1073741824" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:40 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114.45fd8dfa-1521-41d8-8d6a-b187d6721cdb" returned: 0 in 0.246s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:40 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f Jul 17 07:18:40 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-45fd8dfa-1521-41d8-8d6a-b187d6721cdb" released by "_delete_snapshot" :: held 1.431s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" released by "delete_snapshot" :: held 1.455s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Created reservations ['3e49b8bf-144b-4038-883c-b550c500cd31', '8f8b2603-9408-475d-b649-cbdd16e7c844', '94974cd8-e3ac-4c7d-887a-ea8005234fbe', '46370706-7f25-4ecb-a776-004dcbd3cbfd'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Delete snapshot completed successfully. Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e16960ce-3917-4526-a625-6097ec2c5753 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-45fd8dfa-1521-41d8-8d6a-b187d6721cdb-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:40 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea10bd3-3158-4c6f-a304-02180b247f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f46693-a5d8-4039-a26e-af98d7909578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Volume volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f (08e07ca3-8d46-49e9-8fdb-aef138ef5f7f): created successfully Jul 17 07:18:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f46693-a5d8-4039-a26e-af98d7909578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (754c4e68-d53d-4cbc-8754-04542bfe07f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:41 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-247d7b9f-6acb-4940-a7d3-0301200097ed tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Lock "cinder-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" acquired by "delete_volume" :: waited 0.024s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c22f27-9f93-4a95-8d88-fdc4e4c1a0d2]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:41 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 Jul 17 07:18:41 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Flow 'volume_create_manager' (e145cd0d-75f5-42b1-a87a-a79e0c9c33c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c428ac8d-1c70-4af5-a2af-6bd380e2e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c428ac8d-1c70-4af5-a2af-6bd380e2e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2aba9021ba40348c3bd0af5bff03cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08f394c8-0b4a-4e43-8345-8260415734cf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:42Z,use_quota=True,user_id='8d0f655b84254d848dfd9a398220b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bae023-7a19-4fbb-a406-f0d792320e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bae023-7a19-4fbb-a406-f0d792320e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a39c2-29b8-4d1a-afc0-69fe8b5a309f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24a39c2-29b8-4d1a-afc0-69fe8b5a309f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4', 'volume_name': 'volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4', 'volume_size': 1, 'snapshot_id': '08f394c8-0b4a-4e43-8345-8260415734cf'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbd3481-c4ae-444b-9941-59493c6d91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbd3481-c4ae-444b-9941-59493c6d91fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbd464e-3671-43ce-bc24-5d5eb0d04de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:41 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Volume 51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4', 'volume_size': 1, 'snapshot_id': '08f394c8-0b4a-4e43-8345-8260415734cf'} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-quobyte-08f394c8-0b4a-4e43-8345-8260415734cf-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" by "_create_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-08f394c8-0b4a-4e43-8345-8260415734cf-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Creating volume 51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 from snapshot 08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-quobyte-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" by "_copy_volume_from_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] snapshot: 08f394c8-0b4a-4e43-8345-8260415734cf, volume: 51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4, {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ababf5-e5e0-4cef-a3f9-a203cda661c5]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:41 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" returned: 0 in 0.403s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:42 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114 Jul 17 07:18:42 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:42 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf Jul 17 07:18:42 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:42 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" returned: 0 in 0.253s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114" released by "delete_volume" :: held 0.741s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:42 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Creating direct copy from snapshot {{(pid=87331) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06ccb9-e29b-4832-b50c-d864b56d85d8]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Created reservations ['2a83bda8-8690-4c59-a47a-e375ca76859c', '0bc88db7-5b93-43b4-b92a-8fc4badbecff', '242c9d27-b9df-4269-a9aa-bcf1794a7cee', 'dc89595c-6588-4c6a-a11b-1222e1cd477c'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:42 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:42 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:42 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:42 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:42 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Deleted volume successfully. Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-49086a24-16ad-4f92-b9d9-892d78bb111b tempest-ProjectReaderTests-1617595905 None] Lock "cinder-ad917cc3-d87b-4fe0-b9bd-8163a7fc5114-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:42 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.416s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG cinder.utils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Path /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 not found in is_blk_device check {{(pid=87331) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 17 07:18:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:42 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 Jul 17 07:18:42 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (0af71e36-97d3-421e-b910-5a97aae63b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f030dc1d-9ff9-479f-b599-af37692d974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f030dc1d-9ff9-479f-b599-af37692d974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302577661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe641e1-de51-4e85-b13b-9affca20a003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:43Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc45bc4c-8b93-4bd9-a242-e71338bdb22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc45bc4c-8b93-4bd9-a242-e71338bdb22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbc144c-811c-44f4-9ac1-e32b2cde36be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbc144c-811c-44f4-9ac1-e32b2cde36be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe641e1-de51-4e85-b13b-9affca20a003', 'volume_name': 'volume-ebe641e1-de51-4e85-b13b-9affca20a003', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d4d2aa-44b9-419c-aa01-b7a9f43489ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d4d2aa-44b9-419c-aa01-b7a9f43489ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33afca4f-9d4a-41a7-a3aa-48d439e6105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:43 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Volume ebe641e1-de51-4e85-b13b-9affca20a003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe641e1-de51-4e85-b13b-9affca20a003', 'volume_size': 1} Jul 17 07:18:43 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:46 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" returned: 0 in 4.180s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:46 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e04ce-f05b-4bdc-9a47-235aa3dfe147]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:46 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:47 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:47 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:47 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.562s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.image.image_utils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Image conversion details: src /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 {{(pid=87331) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 17 07:18:47 devstack cinder-volume[87331]: INFO cinder.image.image_utils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Converted 1024.00 MB image at 244.90 MB/s Jul 17 07:18:47 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 is being set with open permissions: ugo+rw Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:47 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 Jul 17 07:18:47 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:47 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" returned: 0 in 0.233s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" released by "_copy_volume_from_snapshot" :: held 5.857s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-08f394c8-0b4a-4e43-8345-8260415734cf-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" released by "_create_volume_from_snapshot" :: held 5.886s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.902s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.900s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot 9993bb26-413d-421e-ad14-1aa1f7ce7d46 of volume 08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbd464e-3671-43ce-bc24-5d5eb0d04de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4', 'volume_size': 1, 'snapshot_id': '08f394c8-0b4a-4e43-8345-8260415734cf'}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee4acff-6b69-4465-a609-c81e1831cd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab5396-060c-48ea-96dc-6355b2bf6de0]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:47 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Volume volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 (51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4): created successfully Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee4acff-6b69-4465-a609-c81e1831cd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:47 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Flow 'volume_create_manager' (e145cd0d-75f5-42b1-a87a-a79e0c9c33c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:47 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-32ff68c4-6aab-4575-87f4-1ad4de04a29e tempest-SnapshotDependencyTests-502188959 None] Created volume successfully. Jul 17 07:18:47 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f Jul 17 07:18:47 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:48 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" returned: 0 in 0.353s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:48 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 1G Jul 17 07:18:48 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-08f394c8-0b4a-4e43-8345-8260415734cf-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-08f394c8-0b4a-4e43-8345-8260415734cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-quobyte-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-quobyte-08f394c8-0b4a-4e43-8345-8260415734cf" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-08f394c8-0b4a-4e43-8345-8260415734cf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Deleting offline snapshot 08f394c8-0b4a-4e43-8345-8260415734cf of volume 4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] snapshot_file for this snap is: volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa2a1c9-a4fd-4e38-b919-51be15c2dae1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:48 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf Jul 17 07:18:48 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:48 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 1G" returned: 0 in 0.452s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:48 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 Jul 17 07:18:48 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:48 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[565de82d-68d2-49db-bbad-a9838e6a4979]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:48 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46" returned: 0 in 0.281s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:48 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 is being set with open permissions: ugo+rw Jul 17 07:18:48 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:48 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:48 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:48 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 Jul 17 07:18:48 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:49 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46" returned: 0 in 0.235s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:49 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info Jul 17 07:18:49 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:49 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.386s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:49 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf Jul 17 07:18:49 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:49 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info" returned: 0 in 0.264s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:49 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info is being set with open permissions: ugo+rw Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:49 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info Jul 17 07:18:49 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:49 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf" returned: 0 in 0.330s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:49 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf Jul 17 07:18:49 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:49 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.info" returned: 0 in 0.243s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.493s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302577661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe641e1-de51-4e85-b13b-9affca20a003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:43Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Creating volume ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:49 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:49 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 1073741824 Jul 17 07:18:49 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-5089d020-f6e3-4128-bad9-cd6d4b88034e tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:18:49 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b.08f394c8-0b4a-4e43-8345-8260415734cf" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-08f394c8-0b4a-4e43-8345-8260415734cf" released by "_delete_snapshot" :: held 1.443s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" released by "delete_snapshot" :: held 1.468s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Created reservations ['7e318e05-3654-42d5-a165-facf792198d1', '9b1b74ce-0c5e-45bc-bd4f-88bfcab38aa9', 'c036847d-42c6-4ff5-bc3f-7bda57c19c9c', '2b85da30-4494-47f2-83eb-cd8ed0f87d89'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:49 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Delete snapshot completed successfully. Jul 17 07:18:49 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-bc939f28-642b-4aff-b57a-79f3e6df7bb9 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-08f394c8-0b4a-4e43-8345-8260415734cf-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:50 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 1073741824" returned: 0 in 0.461s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:50 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 Jul 17 07:18:50 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-9993bb26-413d-421e-ad14-1aa1f7ce7d46-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-9993bb26-413d-421e-ad14-1aa1f7ce7d46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-9993bb26-413d-421e-ad14-1aa1f7ce7d46" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-9993bb26-413d-421e-ad14-1aa1f7ce7d46" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot 9993bb26-413d-421e-ad14-1aa1f7ce7d46 of volume 08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f0b648-53ff-49ac-aaca-591c321d865c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:50 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 Jul 17 07:18:50 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:50 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003" returned: 0 in 0.268s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33afca4f-9d4a-41a7-a3aa-48d439e6105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe641e1-de51-4e85-b13b-9affca20a003', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbe2e10-02fa-46a6-b6dc-bd96547524af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:50 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Volume volume-ebe641e1-de51-4e85-b13b-9affca20a003 (ebe641e1-de51-4e85-b13b-9affca20a003): created successfully Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbe2e10-02fa-46a6-b6dc-bd96547524af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (0af71e36-97d3-421e-b910-5a97aae63b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:50 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-defe8633-249a-451e-83e4-b3773352d33e tempest-ProjectReaderTests-1617595905 None] Created volume successfully. Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-quobyte-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caf22c5-9808-4ee9-bd35-e666c615d48c]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:50 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46" returned: 0 in 0.418s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:50 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:50 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[074fe7a2-d569-4cc3-b968-c907f861d497]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Creating offline snapshot 8c529baf-40d9-45eb-9fc2-db9e2dd75d9a of volume ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:50 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f Jul 17 07:18:50 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f1012-59ea-40e2-bd4e-bdd82ab6f185]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:50 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.381s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b Jul 17 07:18:51 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 Jul 17 07:18:51 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" returned: 0 in 0.439s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 Jul 17 07:18:51 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b" released by "delete_volume" :: held 0.727s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:51 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003" returned: 0 in 0.400s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a 1G Jul 17 07:18:51 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Created reservations ['44fa05c5-35ce-4075-a935-65538f16540b', '108551ba-27eb-4163-8617-cd0c7c6c0e51', '355d5b97-a1dc-4a76-87e4-445d7125cffa', '4c6046e9-201c-482e-b410-5995d2c30408'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:51 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46" returned: 0 in 0.377s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46 Jul 17 07:18:51 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:51 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "cinder-quobyte-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:51 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Deleted volume successfully. Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" acquired by "delete_volume" :: waited 0.031s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-df58a81c-0aac-4d2b-b5d6-ab6763d25983 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-4bcad491-8a1a-4f7e-9b1d-ec063e59f59b-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e2bf93-8289-4f2b-a121-ca455a402f34]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a 1G" returned: 0 in 0.528s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe641e1-de51-4e85-b13b-9affca20a003 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:51 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe641e1-de51-4e85-b13b-9affca20a003 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a Jul 17 07:18:51 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:51 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 Jul 17 07:18:51 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f.9993bb26-413d-421e-ad14-1aa1f7ce7d46" returned: 0 in 0.352s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-9993bb26-413d-421e-ad14-1aa1f7ce7d46" released by "_delete_snapshot" :: held 1.714s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:51 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" released by "delete_snapshot" :: held 1.740s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Created reservations ['499290c0-1b77-4df2-ab7c-58c2576ae144', '1170b4ec-3a9c-4d80-bb68-5a40952a4ad0', '8bb6bfda-1aa0-4e93-9427-4c9e7a5b9b3d', '188eff44-a66f-487b-96b8-171f85487294'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:52 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ee7c4ef9-f175-4dcc-89a3-d7cad22269b6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-9993bb26-413d-421e-ad14-1aa1f7ce7d46-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:52 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe641e1-de51-4e85-b13b-9affca20a003 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" returned: 0 in 0.327s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a is being set with open permissions: ugo+rw Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" returned: 0 in 0.385s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a Jul 17 07:18:52 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:52 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4 Jul 17 07:18:52 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:52 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" acquired by "delete_volume" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:52 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" returned: 0 in 0.313s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3765256-1801-46dd-b135-c1842e3d4fff]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-quobyte-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4" released by "delete_volume" :: held 0.770s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:52 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info Jul 17 07:18:52 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Created reservations ['6075f60f-9eae-429a-b583-eaea0ccf0bbf', '02c74df7-243a-4a42-8a09-fdf4c540d3c3', '6381621f-c4bd-45e5-9384-263fbb3e4d65', 'afde0611-02e7-43ec-b74d-73f083e2bf50'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:52 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f Jul 17 07:18:52 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:52 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:52 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info" returned: 0 in 0.267s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info is being set with open permissions: ugo+rw Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info Jul 17 07:18:52 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:52 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" returned: 0 in 0.445s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:52 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.321s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:52 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:52 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f Jul 17 07:18:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Deleted volume successfully. Jul 17 07:18:52 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-71504777-4082-4347-a294-f10e3881bb49 tempest-SnapshotDependencyTests-502188959 None] Lock "cinder-51d7bb8d-0c62-4c93-973d-2fe87f5cb8b4-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:53 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.info" returned: 0 in 0.301s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0b154393-7813-4ad1-98df-7374c3ea29b9 tempest-ProjectReaderTests-1617595905 None] Create snapshot completed successfully Jul 17 07:18:53 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" returned: 0 in 0.283s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f" released by "delete_volume" :: held 0.802s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Created reservations ['a4165074-501f-485f-bf85-4d3361b597a7', 'afeec568-c43d-45c2-8e3e-a9ab218cd57f', 'b5bb0b27-667e-40d5-a346-44c0696f7999', '957330cf-484e-4230-9e8b-23184e47ce59'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:53 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:53 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:53 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.299s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:53 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:18:53 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fbb5c32a-6399-4b4d-84f7-dd2abe061d87 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-08e07ca3-8d46-49e9-8fdb-aef138ef5f7f-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-8c529baf-40d9-45eb-9fc2-db9e2dd75d9a-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-8c529baf-40d9-45eb-9fc2-db9e2dd75d9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-ebe641e1-de51-4e85-b13b-9affca20a003" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (8e04219f-6b13-4895-8cbb-ff4a056be0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5923fa7f-3c50-4b0e-9ec9-9378720400bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5923fa7f-3c50-4b0e-9ec9-9378720400bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-811547712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd2d517-8f5f-4381-8d0a-26de420abc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:54Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2016258a-48e6-4e0d-94e0-690d2cc9a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2016258a-48e6-4e0d-94e0-690d2cc9a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dedf00-3f98-41c3-a69b-a79bfdcebc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dedf00-3f98-41c3-a69b-a79bfdcebc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd2d517-8f5f-4381-8d0a-26de420abc1f', 'volume_name': 'volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18008793-f9bc-45a8-ab22-7b64ee04f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18008793-f9bc-45a8-ab22-7b64ee04f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca73b5c4-b156-4a58-9449-d9b7516e0ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:54 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Volume 6cd2d517-8f5f-4381-8d0a-26de420abc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f', 'volume_size': 1} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-811547712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd2d517-8f5f-4381-8d0a-26de420abc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:54Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Creating volume 6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:54 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ebe641e1-de51-4e85-b13b-9affca20a003" acquired by "delete_snapshot" :: waited 0.118s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:54 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f 1073741824 Jul 17 07:18:54 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Deleting offline snapshot 8c529baf-40d9-45eb-9fc2-db9e2dd75d9a of volume ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] snapshot_file for this snap is: volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff87515-4357-4738-ac81-0fb6e0c545c1]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:54 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a Jul 17 07:18:54 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:54 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" returned: 0 in 0.433s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe641e1-de51-4e85-b13b-9affca20a003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:18:54 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f 1073741824" returned: 0 in 0.531s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9575fed-6500-4412-b5ac-277e53612537]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:54 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:54 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f Jul 17 07:18:54 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:54 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 Jul 17 07:18:54 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:55 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f" returned: 0 in 0.270s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca73b5c4-b156-4a58-9449-d9b7516e0ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abaf985-1d4b-4ce6-ba74-a5aac0deabc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:55 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Volume volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f (6cd2d517-8f5f-4381-8d0a-26de420abc1f): created successfully Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abaf985-1d4b-4ce6-ba74-a5aac0deabc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (8e04219f-6b13-4895-8cbb-ff4a056be0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:55 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7cf09fdf-04b9-4a2c-868e-c5bdb7530d10 tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:18:55 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003" returned: 0 in 0.441s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:55 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a Jul 17 07:18:55 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:55 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" returned: 0 in 0.381s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:55 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a Jul 17 07:18:55 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:55 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003.8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" returned: 0 in 0.325s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-8c529baf-40d9-45eb-9fc2-db9e2dd75d9a" released by "_delete_snapshot" :: held 1.691s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:55 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ebe641e1-de51-4e85-b13b-9affca20a003" released by "delete_snapshot" :: held 1.723s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Created reservations ['3fbebcba-de37-4922-91f9-e6cc2f09488d', 'be5f8bd5-4898-40f2-a93e-38a0d72ecf43', 'e72a770e-8038-40f6-8827-baab7b24b0a0', 'caa6b35e-ae65-451d-af2a-5f4493ab2513'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:56 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Delete snapshot completed successfully. Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-80da9c22-523b-43c9-81ba-aecd86215900 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-8c529baf-40d9-45eb-9fc2-db9e2dd75d9a-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-ebe641e1-de51-4e85-b13b-9affca20a003-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-ebe641e1-de51-4e85-b13b-9affca20a003-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-ebe641e1-de51-4e85-b13b-9affca20a003" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ebe641e1-de51-4e85-b13b-9affca20a003" acquired by "delete_volume" :: waited 0.025s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c57af-c58b-46d8-ac34-c8da81016253]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot a52319ca-dfa3-492a-b318-1a5c1363d4f2 of volume 6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81547d-db9e-41f8-89b7-bb4b75da7227]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:56 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 Jul 17 07:18:56 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:56 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f Jul 17 07:18:56 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:56 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003" returned: 0 in 0.436s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:56 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003 Jul 17 07:18:56 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:56 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f" returned: 0 in 0.443s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:56 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:56 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 1G Jul 17 07:18:56 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:57 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ebe641e1-de51-4e85-b13b-9affca20a003" returned: 0 in 0.261s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-ebe641e1-de51-4e85-b13b-9affca20a003" released by "delete_volume" :: held 0.777s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Created reservations ['7b66263d-93f9-4219-9056-a78807dbe5dc', 'ab3b2a74-e6a9-4f88-a493-782054d32177', '7a93ed09-842f-47f7-92e8-beac9a7b83f3', '0e465fb2-8da7-4645-9863-8505e0cd987a'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:57 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:18:57 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:57 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 1G" returned: 0 in 0.446s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:57 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 Jul 17 07:18:57 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:57 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.297s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:18:57 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Deleted volume successfully. Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-ff0ea595-f250-4557-8706-9c5bee776946 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-ebe641e1-de51-4e85-b13b-9affca20a003-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:18:57 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2" returned: 0 in 0.351s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:57 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 is being set with open permissions: ugo+rw Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:57 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 Jul 17 07:18:57 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:57 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:57 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2" returned: 0 in 0.257s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:58 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info Jul 17 07:18:58 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (95d06a6a-06a3-4169-8cda-6859d31fa70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d02c0b0-8fe7-4e94-9028-66beca902c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d02c0b0-8fe7-4e94-9028-66beca902c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746585949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36689802-85d1-4f95-b23f-d002090e0ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:58Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209d9b16-1cda-4ea4-a8a8-7d02e0d68b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209d9b16-1cda-4ea4-a8a8-7d02e0d68b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5a5b68-d7ef-4692-8ddb-2672f863e1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5a5b68-d7ef-4692-8ddb-2672f863e1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36689802-85d1-4f95-b23f-d002090e0ebb', 'volume_name': 'volume-36689802-85d1-4f95-b23f-d002090e0ebb', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd40e41-dbfa-41f7-a2a3-4646c8b227f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd40e41-dbfa-41f7-a2a3-4646c8b227f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd47cde-e61d-4e89-b60f-79f1e6857f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:58 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Volume 36689802-85d1-4f95-b23f-d002090e0ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36689802-85d1-4f95-b23f-d002090e0ebb', 'volume_size': 1} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:58 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:58 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info is being set with open permissions: ugo+rw Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:58 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info Jul 17 07:18:58 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:58 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.info" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746585949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36689802-85d1-4f95-b23f-d002090e0ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:18:58Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Creating volume 36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:18:58 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:18:58 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:58 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb 1073741824 Jul 17 07:18:58 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:58 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-478ff080-9490-40e3-8ae0-3920358e99b6 tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:18:59 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb 1073741824" returned: 0 in 0.490s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:59 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb Jul 17 07:18:59 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:18:59 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd47cde-e61d-4e89-b60f-79f1e6857f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36689802-85d1-4f95-b23f-d002090e0ebb', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b955f03f-5abe-435d-9dc1-3e568adcd8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:18:59 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Volume volume-36689802-85d1-4f95-b23f-d002090e0ebb (36689802-85d1-4f95-b23f-d002090e0ebb): created successfully Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b955f03f-5abe-435d-9dc1-3e568adcd8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (95d06a6a-06a3-4169-8cda-6859d31fa70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:18:59 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cc69a589-409b-43d8-bb56-6994ea41df2d tempest-ProjectReaderTests-1617595905 None] Created volume successfully. Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-a52319ca-dfa3-492a-b318-1a5c1363d4f2-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-a52319ca-dfa3-492a-b318-1a5c1363d4f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-6cd2d517-8f5f-4381-8d0a-26de420abc1f" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6cd2d517-8f5f-4381-8d0a-26de420abc1f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-a52319ca-dfa3-492a-b318-1a5c1363d4f2" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-a52319ca-dfa3-492a-b318-1a5c1363d4f2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot a52319ca-dfa3-492a-b318-1a5c1363d4f2 of volume 6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1cd7dc-05fe-4bd6-8c0d-72d93fb27c55]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:18:59 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:18:59 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 Jul 17 07:18:59 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:00 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2" returned: 0 in 0.397s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5adda06-9650-4df1-8e33-91ce9739867b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Creating offline snapshot db813410-c476-42d3-bcb4-0b048a9256e3 of volume 36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:19:00 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f Jul 17 07:19:00 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0090a13d-7a22-4dd7-b8bf-96fe8f9e6d43]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:00 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb Jul 17 07:19:00 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:00 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f" returned: 0 in 0.471s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:00 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 Jul 17 07:19:00 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:00 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb" returned: 0 in 0.449s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:00 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:00 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 1G Jul 17 07:19:00 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:01 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2" returned: 0 in 0.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:01 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2 Jul 17 07:19:01 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:01 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 1G" returned: 0 in 0.442s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36689802-85d1-4f95-b23f-d002090e0ebb -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:01 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36689802-85d1-4f95-b23f-d002090e0ebb -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 Jul 17 07:19:01 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:01 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f.a52319ca-dfa3-492a-b318-1a5c1363d4f2" returned: 0 in 0.293s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-a52319ca-dfa3-492a-b318-1a5c1363d4f2" released by "_delete_snapshot" :: held 1.668s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6cd2d517-8f5f-4381-8d0a-26de420abc1f" released by "delete_snapshot" :: held 1.698s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Created reservations ['7d0e1640-9812-423c-b4fc-bbbd371de63e', '4d4f8401-462d-45ea-b5fc-78fd96ecb0b3', 'aa69c4d7-3bdb-45f4-b8e0-7cb0d03a6f7c', '96b3adae-13e0-4af0-bdb4-5bb65d33f421'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:01 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f476f5a-b56f-4119-b73e-46fe54578be6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-a52319ca-dfa3-492a-b318-1a5c1363d4f2-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:01 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36689802-85d1-4f95-b23f-d002090e0ebb -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3" returned: 0 in 0.365s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:01 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 is being set with open permissions: ugo+rw Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:01 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 Jul 17 07:19:01 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-6cd2d517-8f5f-4381-8d0a-26de420abc1f-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-6cd2d517-8f5f-4381-8d0a-26de420abc1f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-6cd2d517-8f5f-4381-8d0a-26de420abc1f" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:01 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3" returned: 0 in 0.289s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6cd2d517-8f5f-4381-8d0a-26de420abc1f" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c35dcb4-9d49-4029-8fe9-90beab70ea49]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:01 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:02 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info Jul 17 07:19:02 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:02 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f Jul 17 07:19:02 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:02 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info" returned: 0 in 0.292s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:02 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info is being set with open permissions: ugo+rw Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:02 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info Jul 17 07:19:02 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:02 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f" returned: 0 in 0.439s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:02 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f Jul 17 07:19:02 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:02 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.info" returned: 0 in 0.295s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:02 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-40b08919-7117-4062-85bc-65db6df9914d tempest-ProjectReaderTests-1617595905 None] Create snapshot completed successfully Jul 17 07:19:02 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-6cd2d517-8f5f-4381-8d0a-26de420abc1f" returned: 0 in 0.273s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-6cd2d517-8f5f-4381-8d0a-26de420abc1f" released by "delete_volume" :: held 0.781s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Created reservations ['f30824ac-ea1e-48a1-8703-0f514a49fe85', '445e2367-a08c-4434-b33e-68a4880070fc', 'b13fde98-b198-41e3-aa2a-b2679e83f3e7', '778178f3-83f6-4ea5-964a-fd5bdeff98e8'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:02 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:02 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:02 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:03 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.258s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:03 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-181787ef-da92-46b5-b5dc-d8d4ca2f3ae6 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-6cd2d517-8f5f-4381-8d0a-26de420abc1f-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (800d5232-2f73-42b2-8100-7abdbadfcd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c373361-5193-47a5-b69b-9c802948ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c373361-5193-47a5-b69b-9c802948ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522045026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b374b7a-4757-4c31-85ff-a462574293c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:03Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab505a5-fc98-4ed3-be14-618668b1518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab505a5-fc98-4ed3-be14-618668b1518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe3dfab-0bc4-4721-9c05-142bdda55a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe3dfab-0bc4-4721-9c05-142bdda55a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b374b7a-4757-4c31-85ff-a462574293c8', 'volume_name': 'volume-9b374b7a-4757-4c31-85ff-a462574293c8', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db318b1a-64a8-4469-bfe9-c485b36b3da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db318b1a-64a8-4469-bfe9-c485b36b3da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf175334-8a6a-49ce-9b2f-72a78052f8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:03 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Volume 9b374b7a-4757-4c31-85ff-a462574293c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b374b7a-4757-4c31-85ff-a462574293c8', 'volume_size': 1} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522045026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b374b7a-4757-4c31-85ff-a462574293c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:03Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Creating volume 9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:03 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-db813410-c476-42d3-bcb4-0b048a9256e3-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:03 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 1073741824 Jul 17 07:19:03 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-db813410-c476-42d3-bcb4-0b048a9256e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-36689802-85d1-4f95-b23f-d002090e0ebb" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-36689802-85d1-4f95-b23f-d002090e0ebb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-db813410-c476-42d3-bcb4-0b048a9256e3" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-db813410-c476-42d3-bcb4-0b048a9256e3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Deleting offline snapshot db813410-c476-42d3-bcb4-0b048a9256e3 of volume 36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] snapshot_file for this snap is: volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c8c51-51a2-4388-826b-d6d50321db6e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:03 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 Jul 17 07:19:03 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:03 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:03 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 1073741824" returned: 0 in 0.436s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:04 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36689802-85d1-4f95-b23f-d002090e0ebb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:19:04 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 Jul 17 07:19:04 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c37dc8-1a62-4367-8ef5-b5b84e50035f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:04 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb Jul 17 07:19:04 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:04 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf175334-8a6a-49ce-9b2f-72a78052f8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b374b7a-4757-4c31-85ff-a462574293c8', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c015e4ed-cf52-4ba4-a4aa-e2690d148689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:04 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Volume volume-9b374b7a-4757-4c31-85ff-a462574293c8 (9b374b7a-4757-4c31-85ff-a462574293c8): created successfully Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c015e4ed-cf52-4ba4-a4aa-e2690d148689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (800d5232-2f73-42b2-8100-7abdbadfcd7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:04 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-8907463b-0f9c-4e68-998c-c4ce55d726b9 tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:19:04 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:04 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 Jul 17 07:19:04 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot 17e0698b-7cb5-42ce-a0ff-d8e12bb89152 of volume 9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bac4104-88ff-43f3-81d7-e8f4274861af]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:04 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 Jul 17 07:19:04 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:04 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3" returned: 0 in 0.361s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:04 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:04 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3 Jul 17 07:19:04 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:05 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8" returned: 0 in 0.361s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:05 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb.db813410-c476-42d3-bcb4-0b048a9256e3" returned: 0 in 0.256s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:05 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 1G Jul 17 07:19:05 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-db813410-c476-42d3-bcb4-0b048a9256e3" released by "_delete_snapshot" :: held 1.478s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-36689802-85d1-4f95-b23f-d002090e0ebb" released by "delete_snapshot" :: held 1.502s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Created reservations ['e248f56d-4f08-4053-acef-ea4906b0b819', '74538eee-7f2f-4f94-92a6-1ed4f22d2dc1', 'f83636ad-9672-4c49-bee3-061f54893eea', 'f2cd35b9-497a-49e7-b05e-54d4be594242'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:05 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Delete snapshot completed successfully. Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-1f3cad0b-2b14-4682-ad8d-b7cd02fc63c6 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-db813410-c476-42d3-bcb4-0b048a9256e3-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:05 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 1G" returned: 0 in 0.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b374b7a-4757-4c31-85ff-a462574293c8 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:05 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b374b7a-4757-4c31-85ff-a462574293c8 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 Jul 17 07:19:05 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-36689802-85d1-4f95-b23f-d002090e0ebb-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:05 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b374b7a-4757-4c31-85ff-a462574293c8 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152" returned: 0 in 0.298s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:05 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 is being set with open permissions: ugo+rw Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-36689802-85d1-4f95-b23f-d002090e0ebb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:05 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 Jul 17 07:19:05 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-36689802-85d1-4f95-b23f-d002090e0ebb" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-36689802-85d1-4f95-b23f-d002090e0ebb" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7ee6a2-a954-4b60-a6b6-4967dbc64544]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:05 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb Jul 17 07:19:05 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:05 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:05 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152" returned: 0 in 0.263s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:06 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info Jul 17 07:19:06 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:06 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb" returned: 0 in 0.376s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:06 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb Jul 17 07:19:06 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:06 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:06 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info is being set with open permissions: ugo+rw Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:06 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info Jul 17 07:19:06 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:06 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-36689802-85d1-4f95-b23f-d002090e0ebb" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-36689802-85d1-4f95-b23f-d002090e0ebb" released by "delete_volume" :: held 0.691s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:06 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.info" returned: 0 in 0.248s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Created reservations ['c8c7e419-c610-48ca-afe3-1cecd1c3808c', 'f2b02aea-38d7-4028-8a95-609deb646eb9', '86996e62-7c8c-436a-920e-e2dec0e6b577', '8864281e-5b5b-4fb3-8246-40a187136c74'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-9515bea4-d94d-4c2e-a58e-fa4eedf048fa tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:06 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:06 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-17e0698b-7cb5-42ce-a0ff-d8e12bb89152-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-17e0698b-7cb5-42ce-a0ff-d8e12bb89152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-9b374b7a-4757-4c31-85ff-a462574293c8" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-9b374b7a-4757-4c31-85ff-a462574293c8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-17e0698b-7cb5-42ce-a0ff-d8e12bb89152" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-17e0698b-7cb5-42ce-a0ff-d8e12bb89152" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot 17e0698b-7cb5-42ce-a0ff-d8e12bb89152 of volume 9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c210c0-cf8a-40ea-8202-8c685d87254b]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:06 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:06 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Deleted volume successfully. Jul 17 07:19:06 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-4344caa0-f21c-4cbb-a286-353168421b25 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-36689802-85d1-4f95-b23f-d002090e0ebb-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:06 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 Jul 17 07:19:06 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:07 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152" returned: 0 in 0.388s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b374b7a-4757-4c31-85ff-a462574293c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037f747-dd69-4f27-9616-f975f2c744ac]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (5d750c7d-6290-4e3d-8adb-0b9d86ac4a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67672c3f-c2f5-40aa-bd06-a98bb75059ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67672c3f-c2f5-40aa-bd06-a98bb75059ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11427617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:07Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17740f3-95ac-4f85-be76-0b5a9de5ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:07 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 Jul 17 07:19:07 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17740f3-95ac-4f85-be76-0b5a9de5ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed624e80-5e4d-47d4-aa92-ca7dfc439512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed624e80-5e4d-47d4-aa92-ca7dfc439512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3', 'volume_name': 'volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a6426e-7895-4ce9-aa7f-c89fd165210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a6426e-7895-4ce9-aa7f-c89fd165210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b24dd9-cff8-4429-b64a-3aa11fa04fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:07 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Volume 0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3', 'volume_size': 1} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11427617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:07Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Creating volume 0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:07 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:07 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 1073741824 Jul 17 07:19:07 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:07 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:07 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 Jul 17 07:19:07 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:07 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 1073741824" returned: 0 in 0.425s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:07 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:07 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 Jul 17 07:19:07 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:08 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152" returned: 0 in 0.359s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:08 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152 Jul 17 07:19:08 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:08 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b24dd9-cff8-4429-b64a-3aa11fa04fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70ae3bc-5ccd-43e5-b5b8-2e99b0962aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:08 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Volume volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 (0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3): created successfully Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70ae3bc-5ccd-43e5-b5b8-2e99b0962aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (5d750c7d-6290-4e3d-8adb-0b9d86ac4a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:08 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-aace833f-2e2c-41fc-9fac-011755ce85c0 tempest-ProjectReaderTests-1617595905 None] Created volume successfully. Jul 17 07:19:08 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8.17e0698b-7cb5-42ce-a0ff-d8e12bb89152" returned: 0 in 0.282s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-17e0698b-7cb5-42ce-a0ff-d8e12bb89152" released by "_delete_snapshot" :: held 1.520s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-9b374b7a-4757-4c31-85ff-a462574293c8" released by "delete_snapshot" :: held 1.543s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Created reservations ['5c4879b1-3b7f-4faf-837f-be24eb409939', '51359a8f-2ff1-4006-821d-23f6b4549f10', '5b24e65a-644e-4685-96d0-defc0c7b5f34', 'eb0523cc-e69c-42c0-86af-b7d897f60bec'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:08 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-907f96a0-a4b0-428f-b994-177fde53d215 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-17e0698b-7cb5-42ce-a0ff-d8e12bb89152-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Creating offline snapshot a0e6ec09-b472-4b81-91e3-ae717badddd8 of volume 0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ec056-3a6d-48db-b84d-24c9f691dbdd]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:08 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 Jul 17 07:19:08 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:08 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-9b374b7a-4757-4c31-85ff-a462574293c8-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:08 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-9b374b7a-4757-4c31-85ff-a462574293c8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:08 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 1G Jul 17 07:19:08 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-9b374b7a-4757-4c31-85ff-a462574293c8" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-9b374b7a-4757-4c31-85ff-a462574293c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e71926a-c9c6-4758-b8cb-473d16076276]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:09 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 Jul 17 07:19:09 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:09 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 1G" returned: 0 in 0.393s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:09 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 Jul 17 07:19:09 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:09 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8" returned: 0 in 0.381s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:09 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8 Jul 17 07:19:09 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:09 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8" returned: 0 in 0.305s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:09 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 is being set with open permissions: ugo+rw Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:09 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 Jul 17 07:19:09 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:09 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b374b7a-4757-4c31-85ff-a462574293c8" returned: 0 in 0.272s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-9b374b7a-4757-4c31-85ff-a462574293c8" released by "delete_volume" :: held 0.710s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=253,cinder:SELECT=197,cinder:INSERT=59,cinder:DELETE=14 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Created reservations ['563fe7e4-2e54-4c92-96d3-a10dc6448334', '807bbd19-4506-4350-adf0-9f55346ea8dd', '017ee7cb-1907-4d93-956d-e63084431dab', '24782c6f-96c4-45ca-8a6c-c4819dccef13'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:09 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8" returned: 0 in 0.244s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:09 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:09 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:UPDATE=256,cinder:DELETE=30,cinder:SELECT=188,cinder:INSERT=73 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:19:09 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:09 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info Jul 17 07:19:09 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:10 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.256s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-f9e09e6b-4210-42d2-8d2e-3c23f81f2e27 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-9b374b7a-4757-4c31-85ff-a462574293c8-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:10 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info" returned: 0 in 0.276s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:10 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info is being set with open permissions: ugo+rw Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:10 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info Jul 17 07:19:10 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:10 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.info" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:10 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-91b32bd1-35cb-47cd-868c-00717d3a0dcf tempest-ProjectReaderTests-1617595905 None] Create snapshot completed successfully Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (0fc32891-662a-4adc-afcb-ad682b69d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16735a64-4069-4b08-a51c-ecea378543a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16735a64-4069-4b08-a51c-ecea378543a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979870311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab3e518-0088-44d6-97b0-771714eb28a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:11Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833334e8-54e0-4d9b-a801-7d85c965b078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833334e8-54e0-4d9b-a801-7d85c965b078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ca7b5-8417-4c3b-a075-f0ec54086089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ca7b5-8417-4c3b-a075-f0ec54086089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab3e518-0088-44d6-97b0-771714eb28a1', 'volume_name': 'volume-3ab3e518-0088-44d6-97b0-771714eb28a1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a066e8-ecd0-461e-a4e7-2c606f130413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a066e8-ecd0-461e-a4e7-2c606f130413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635fec6c-6b41-4508-9ca7-f4b9aa67f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:10 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Volume 3ab3e518-0088-44d6-97b0-771714eb28a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab3e518-0088-44d6-97b0-771714eb28a1', 'volume_size': 1} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979870311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab3e518-0088-44d6-97b0-771714eb28a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcc8d61734b421cbb43ed893c6ca93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:11Z,use_quota=True,user_id='72a813ae822245ab902122e8b5dcf473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Creating volume 3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:10 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-a0e6ec09-b472-4b81-91e3-ae717badddd8-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:10 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 1073741824 Jul 17 07:19:10 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Lock "cinder-a0e6ec09-b472-4b81-91e3-ae717badddd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-a0e6ec09-b472-4b81-91e3-ae717badddd8" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-a0e6ec09-b472-4b81-91e3-ae717badddd8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Deleting offline snapshot a0e6ec09-b472-4b81-91e3-ae717badddd8 of volume 0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] snapshot_file for this snap is: volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[952539cc-f244-4082-9199-074ef3236d0e]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:10 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:10 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 Jul 17 07:19:10 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:11 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 1073741824" returned: 0 in 0.448s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:11 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4279a2-3bb3-4940-9623-0e50c04f543a]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:11 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 Jul 17 07:19:11 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:11 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 Jul 17 07:19:11 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:11 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635fec6c-6b41-4508-9ca7-f4b9aa67f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab3e518-0088-44d6-97b0-771714eb28a1', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8f13b-c8a8-412d-97d7-1c6cb17cf410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:11 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Volume volume-3ab3e518-0088-44d6-97b0-771714eb28a1 (3ab3e518-0088-44d6-97b0-771714eb28a1): created successfully Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8f13b-c8a8-412d-97d7-1c6cb17cf410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Flow 'volume_create_manager' (0fc32891-662a-4adc-afcb-ad682b69d236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:11 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cb6feaeb-ccf3-4932-9192-3ed613320f78 tempest-ProjectMemberTests-1934738256 None] Created volume successfully. Jul 17 07:19:11 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" returned: 0 in 0.391s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:11 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 Jul 17 07:19:11 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:11 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8" returned: 0 in 0.318s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:11 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:11 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8 Jul 17 07:19:11 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:12 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3.a0e6ec09-b472-4b81-91e3-ae717badddd8" returned: 0 in 0.237s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-a0e6ec09-b472-4b81-91e3-ae717badddd8" released by "_delete_snapshot" :: held 1.410s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" released by "delete_snapshot" :: held 1.431s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Created reservations ['c333a518-6671-430a-9b30-95d2ab7f8dbd', '8208f792-59c5-4393-9ddd-a5b0c8b52363', '86a5366f-27f4-4efa-808a-df605a8921b5', '4c2b463d-1926-4b19-9a04-6641b73af916'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:12 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Delete snapshot completed successfully. Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-692e3f64-8187-40d8-8bb7-a866ad0336da tempest-ProjectReaderTests-1617595905 None] Lock "cinder-a0e6ec09-b472-4b81-91e3-ae717badddd8-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Creating offline snapshot efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 of volume 3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95aafe1-555a-46d0-b51e-c17b37ab16cf]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:12 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 Jul 17 07:19:12 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:12 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9a426c-38b0-4529-8695-9a47440e9572]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:13 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 Jul 17 07:19:13 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:13 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1" returned: 0 in 0.427s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:13 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 1G Jul 17 07:19:13 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:13 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" returned: 0 in 0.379s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:13 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3 Jul 17 07:19:13 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:13 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 1G" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ab3e518-0088-44d6-97b0-771714eb28a1 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:13 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:13 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ab3e518-0088-44d6-97b0-771714eb28a1 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 Jul 17 07:19:13 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" returned: 0 in 0.266s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3" released by "delete_volume" :: held 0.715s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Created reservations ['0bd2f924-988c-4fca-8644-ba74acea978a', '8afbd93d-bbc5-43e8-be98-4d99468a7784', '89469d97-5c67-4e38-a841-6ad6eda42473', '3c763589-f1bf-48cc-8226-c4dc06f398e1'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:13 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:13 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:13 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ab3e518-0088-44d6-97b0-771714eb28a1 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:13 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 is being set with open permissions: ugo+rw Jul 17 07:19:13 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:13 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 Jul 17 07:19:13 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:14 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.258s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Deleted volume successfully. Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-cd2603b3-04ff-45c0-b177-47a5037d9301 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-0ba0beda-bf92-4fa4-b5ec-7ddcff486cc3-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:14 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" returned: 0 in 0.273s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:14 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info Jul 17 07:19:14 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:14 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:14 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info is being set with open permissions: ugo+rw Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:14 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info Jul 17 07:19:14 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (85a4824f-8438-4e89-afaf-c5f29db704f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe63603-e19c-4a73-9495-0125e26c54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe63603-e19c-4a73-9495-0125e26c54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913323240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51590b25-1f23-4fa5-ac25-72c3e6971360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:14Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99111bcd-b5f4-4e4f-acf5-f42ca23c0c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99111bcd-b5f4-4e4f-acf5-f42ca23c0c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37d5dc9-659c-42fd-b62c-2e4e7b9cb4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37d5dc9-659c-42fd-b62c-2e4e7b9cb4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51590b25-1f23-4fa5-ac25-72c3e6971360', 'volume_name': 'volume-51590b25-1f23-4fa5-ac25-72c3e6971360', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a62508-c604-436d-aede-bece51b346d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a62508-c604-436d-aede-bece51b346d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e7c284-4068-4013-932f-3cd9e80f9951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:14 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Volume 51590b25-1f23-4fa5-ac25-72c3e6971360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51590b25-1f23-4fa5-ac25-72c3e6971360', 'volume_size': 1} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:14 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.info" returned: 0 in 0.243s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913323240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51590b25-1f23-4fa5-ac25-72c3e6971360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c404e89bd544ebab0bb6fce3bb406f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:14Z,use_quota=True,user_id='bfb90e2c41504eb2a8aef95cf29cc4ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Creating volume 51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:14 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:14 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:14 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 1073741824 Jul 17 07:19:14 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:14 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-7eb8bdb6-e8a8-4100-8206-bf6e1b4f337a tempest-ProjectMemberTests-1934738256 None] Create snapshot completed successfully Jul 17 07:19:15 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 1073741824" returned: 0 in 0.399s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:15 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 Jul 17 07:19:15 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:15 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360" returned: 0 in 0.236s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e7c284-4068-4013-932f-3cd9e80f9951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51590b25-1f23-4fa5-ac25-72c3e6971360', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4775c5cf-f12c-4d5b-b93e-16c78d71a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:15 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Volume volume-51590b25-1f23-4fa5-ac25-72c3e6971360 (51590b25-1f23-4fa5-ac25-72c3e6971360): created successfully Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4775c5cf-f12c-4d5b-b93e-16c78d71a137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:15 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Flow 'volume_create_manager' (85a4824f-8438-4e89-afaf-c5f29db704f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:15 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3657fe67-18a0-49e5-86e7-b74dcb548f47 tempest-ProjectReaderTests-1617595905 None] Created volume successfully. Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-efd32cb7-f7f7-4e1d-8fc7-a440efffdad3-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-efd32cb7-f7f7-4e1d-8fc7-a440efffdad3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-3ab3e518-0088-44d6-97b0-771714eb28a1" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3ab3e518-0088-44d6-97b0-771714eb28a1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Deleting offline snapshot efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 of volume 3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] snapshot_file for this snap is: volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[87327fa9-3605-47a6-b227-4a0bbe0be372]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:16 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 Jul 17 07:19:16 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:16 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" returned: 0 in 0.352s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ab3e518-0088-44d6-97b0-771714eb28a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e8743c-17cb-4034-92df-4be5cab94894]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:16 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 Jul 17 07:19:16 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Creating offline snapshot 930d69b1-e4da-4231-a6f6-16fba58dc786 of volume 51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[42746465-9bcf-464b-a8fe-ac5343e5d956]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:16 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1" returned: 0 in 0.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:16 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:16 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 Jul 17 07:19:16 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:16 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 Jul 17 07:19:16 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:17 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360" returned: 0 in 0.372s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 1G {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:17 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 1G Jul 17 07:19:17 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:17 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" returned: 0 in 0.347s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:17 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3 Jul 17 07:19:17 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:17 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1.efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-efd32cb7-f7f7-4e1d-8fc7-a440efffdad3" released by "_delete_snapshot" :: held 1.430s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3ab3e518-0088-44d6-97b0-771714eb28a1" released by "delete_snapshot" :: held 1.452s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Created reservations ['5432b4d1-78bc-4a8f-8d61-f2c4ca4e7a85', 'b8a88b02-178f-47fe-9fa9-f438f43df945', 'b90dd1d6-3aaa-4f3d-b775-d23f4cf9473f', '684edb0a-1534-4328-a2e3-c44c86a11913'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:17 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 1G" returned: 0 in 0.405s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51590b25-1f23-4fa5-ac25-72c3e6971360 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:17 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51590b25-1f23-4fa5-ac25-72c3e6971360 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 Jul 17 07:19:17 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:17 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Delete snapshot completed successfully. Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-323114e3-710f-4ae6-a957-9ba656e35566 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-efd32cb7-f7f7-4e1d-8fc7-a440efffdad3-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:17 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51590b25-1f23-4fa5-ac25-72c3e6971360 -F qcow2 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786" returned: 0 in 0.290s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:17 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 is being set with open permissions: ugo+rw Jul 17 07:19:17 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:17 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 Jul 17 07:19:17 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:18 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786" returned: 0 in 0.246s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-3ab3e518-0088-44d6-97b0-771714eb28a1-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:18 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info Jul 17 07:19:18 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-3ab3e518-0088-44d6-97b0-771714eb28a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "cinder-quobyte-3ab3e518-0088-44d6-97b0-771714eb28a1" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3ab3e518-0088-44d6-97b0-771714eb28a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf9223b-d11b-4e50-bea1-84d020682a55]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:18 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 Jul 17 07:19:18 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:18 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:18 devstack cinder-volume[87331]: WARNING cinder.volume.drivers.remotefs [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info is being set with open permissions: ugo+rw Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:18 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info Jul 17 07:19:18 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:18 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1" returned: 0 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:18 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.info" returned: 0 in 0.256s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:18 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1 Jul 17 07:19:18 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:18 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-3e01de20-99ee-46a0-b53b-d45e840b769a tempest-ProjectReaderTests-1617595905 None] Create snapshot completed successfully Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-930d69b1-e4da-4231-a6f6-16fba58dc786-delete_snapshot" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-930d69b1-e4da-4231-a6f6-16fba58dc786-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:18 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-51590b25-1f23-4fa5-ac25-72c3e6971360" by "delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-3ab3e518-0088-44d6-97b0-771714eb28a1" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-quobyte-3ab3e518-0088-44d6-97b0-771714eb28a1" released by "delete_volume" :: held 0.736s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-51590b25-1f23-4fa5-ac25-72c3e6971360" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-930d69b1-e4da-4231-a6f6-16fba58dc786" by "_delete_snapshot" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:18 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-930d69b1-e4da-4231-a6f6-16fba58dc786" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Deleting offline snapshot 930d69b1-e4da-4231-a6f6-16fba58dc786 of volume 51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] snapshot_file for this snap is: volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 {{(pid=87331) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb12f4-e5ef-47fb-bea1-f9f43d3ec7a4]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Created reservations ['3fef0bb9-0cb1-456d-90a9-d9abaaa29f2d', '9c14c375-50fd-4436-a805-71ee7eec33c4', '370a088f-2d35-4833-a069-715354313da3', '315eafee-7f10-475e-bd97-d578beb99f06'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:19 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 Jul 17 07:19:19 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:19 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:19 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:19 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.252s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:19 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Deleted volume successfully. Jul 17 07:19:19 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786" returned: 0 in 0.378s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51590b25-1f23-4fa5-ac25-72c3e6971360(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87331) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-e0a8c921-e847-4a1e-a960-6b179c7decf3 tempest-ProjectMemberTests-1934738256 None] Lock "cinder-3ab3e518-0088-44d6-97b0-771714eb28a1-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7496c-a7b7-48e0-9bb6-56fb5e2f4f61]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:19 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 Jul 17 07:19:19 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:19 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360" returned: 0 in 0.383s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:19 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:19 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 Jul 17 07:19:19 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:20 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786" returned: 0 in 0.362s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:20 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786 Jul 17 07:19:20 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:20 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360.930d69b1-e4da-4231-a6f6-16fba58dc786" returned: 0 in 0.269s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-930d69b1-e4da-4231-a6f6-16fba58dc786" released by "_delete_snapshot" :: held 1.496s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-51590b25-1f23-4fa5-ac25-72c3e6971360" released by "delete_snapshot" :: held 1.523s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Created reservations ['03ada4d9-0974-4776-9a13-b5c6a58aa935', '3302a9e2-b6f0-4108-be3a-b3d445d24c33', 'b1c26479-c1f5-42a9-8e8f-80909e0aaed3', '1705b1f6-1c8d-428c-90ac-4c77b0fc6f27'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:20 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Delete snapshot completed successfully. Jul 17 07:19:20 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-fd1b42b0-4d27-47bf-8104-a5f772506a67 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-930d69b1-e4da-4231-a6f6-16fba58dc786-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-51590b25-1f23-4fa5-ac25-72c3e6971360-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-51590b25-1f23-4fa5-ac25-72c3e6971360-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "cinder-quobyte-51590b25-1f23-4fa5-ac25-72c3e6971360" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-51590b25-1f23-4fa5-ac25-72c3e6971360" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa110ce2-cbb0-4030-97ba-f3bed388dea6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:21 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 Jul 17 07:19:21 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:21 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360" returned: 0 in 0.386s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:21 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360 Jul 17 07:19:21 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:21 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-51590b25-1f23-4fa5-ac25-72c3e6971360" returned: 0 in 0.255s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-quobyte-51590b25-1f23-4fa5-ac25-72c3e6971360" released by "delete_volume" :: held 0.706s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Created reservations ['f76a9598-5c01-4bcb-9d35-ef947bd69189', 'a6bd64fd-98d4-4bf9-a2cd-3fc684abd178', 'a77711cd-c8b3-4829-bb39-52eb7de48388', 'ed0fcdb9-ff04-445e-94b1-89c69d642ba5'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:21 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:21 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:21 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:22 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:22 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.259s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:22 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:22 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Deleted volume successfully. Jul 17 07:19:22 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-48d044ce-ad71-4475-8b86-7a9d1e8f06a7 tempest-ProjectReaderTests-1617595905 None] Lock "cinder-51590b25-1f23-4fa5-ac25-72c3e6971360-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:27 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (85dd40dd-bc90-4eb3-b62f-7cc83fe641bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8366752d-25ba-4aca-b410-68898ac68c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8366752d-25ba-4aca-b410-68898ac68c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1263977240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84d320f-95a3-4f03-ad9b-d6f8639ebbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:28Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad53a5a7-ee64-4f01-943d-a240e215b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad53a5a7-ee64-4f01-943d-a240e215b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aee95a-41b5-447a-a0a0-5f14d5ac8798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aee95a-41b5-447a-a0a0-5f14d5ac8798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f84d320f-95a3-4f03-ad9b-d6f8639ebbe7', 'volume_name': 'volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b164b29b-48d2-4295-a08f-898a78b86e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b164b29b-48d2-4295-a08f-898a78b86e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bdbc7f-7902-4df4-8b77-6995881d1993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Volume f84d320f-95a3-4f03-ad9b-d6f8639ebbe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7', 'volume_size': 1} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1263977240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84d320f-95a3-4f03-ad9b-d6f8639ebbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:28Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Creating volume f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:28 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:28 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 1073741824 Jul 17 07:19:28 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:28 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 1073741824" returned: 0 in 0.411s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:28 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 Jul 17 07:19:28 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:28 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7" returned: 0 in 0.257s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bdbc7f-7902-4df4-8b77-6995881d1993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e76557e-115c-4647-948c-ce3952d3d6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:28 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Volume volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 (f84d320f-95a3-4f03-ad9b-d6f8639ebbe7): created successfully Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e76557e-115c-4647-948c-ce3952d3d6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:28 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (85dd40dd-bc90-4eb3-b62f-7cc83fe641bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:28 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6ccb0073-a420-499f-8615-e51fa5a71495 tempest-ProjectReaderTests-587791877 None] Created volume successfully. Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:29 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:29 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:29 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Lock "cinder-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-quobyte-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7" acquired by "delete_volume" :: waited 0.017s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea2901-1ed6-4b28-af29-00b94eba2c1f]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:30 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.260s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_service.periodic_task [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] Running periodic task VolumeManager._thread_info {{(pid=87331) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread count: 28 {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-fa7d4ee4-5eec-41d4-8e41-dc8343ec19d7 None None] thread info: [<_MainThread(MainThread, started 126838170017920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87331) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 17 07:19:30 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 Jul 17 07:19:30 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:30 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7" returned: 0 in 0.364s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:30 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7 Jul 17 07:19:30 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:30 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7" returned: 0 in 0.287s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7" released by "delete_volume" :: held 0.692s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Created reservations ['8796f320-047f-40d2-a87a-04e11df97f38', 'e80600c7-9be0-4ab8-b11c-db8228d8f39e', '5ca4c618-b723-4b47-a6a0-dd55ce2651c7', 'a6b52451-0ffb-4105-aadd-75d3f540b836'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:30 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:30 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:30 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:31 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.279s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:31 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Deleted volume successfully. Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-6067a045-4436-4e9c-afda-36307f21e64e tempest-ProjectReaderTests-587791877 None] Lock "cinder-f84d320f-95a3-4f03-ad9b-d6f8639ebbe7-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (5920f7c5-69e2-493d-9d80-72dc0175722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34388d79-fe7e-467a-879d-a8649c4508e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34388d79-fe7e-467a-879d-a8649c4508e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201447545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d14920-569e-4ea8-b92b-f6b6d3c5e000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:32Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43098b93-5531-4da3-94f9-d996f5584793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43098b93-5531-4da3-94f9-d996f5584793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32928d5b-97e4-49ba-9981-cb5ab6ec9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32928d5b-97e4-49ba-9981-cb5ab6ec9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d14920-569e-4ea8-b92b-f6b6d3c5e000', 'volume_name': 'volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080a6e26-c2e2-4108-9c1d-3b09aac51cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080a6e26-c2e2-4108-9c1d-3b09aac51cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09178e7-2de3-461f-a498-122da019aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:31 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Volume 00d14920-569e-4ea8-b92b-f6b6d3c5e000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000', 'volume_size': 1} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201447545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d14920-569e-4ea8-b92b-f6b6d3c5e000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:32Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Creating volume 00d14920-569e-4ea8-b92b-f6b6d3c5e000 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:31 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:31 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:31 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 1073741824 Jul 17 07:19:31 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:32 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 1073741824" returned: 0 in 0.504s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:32 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 Jul 17 07:19:32 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:32 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000" returned: 0 in 0.273s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09178e7-2de3-461f-a498-122da019aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc44168a-a118-48e5-8c09-7d113d3af0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:32 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Volume volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 (00d14920-569e-4ea8-b92b-f6b6d3c5e000): created successfully Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc44168a-a118-48e5-8c09-7d113d3af0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:32 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (5920f7c5-69e2-493d-9d80-72dc0175722f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:32 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0d4e2785-76a3-498c-b3bb-d2862ca03844 tempest-ProjectReaderTests-587791877 None] Created volume successfully. Jul 17 07:19:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-00d14920-569e-4ea8-b92b-f6b6d3c5e000-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Lock "cinder-00d14920-569e-4ea8-b92b-f6b6d3c5e000-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-quobyte-00d14920-569e-4ea8-b92b-f6b6d3c5e000" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:33 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-00d14920-569e-4ea8-b92b-f6b6d3c5e000" acquired by "delete_volume" :: waited 0.015s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:33 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fefb499-6b18-4f61-a095-8c5c8b26269d]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:33 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:34 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 Jul 17 07:19:34 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:34 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000" returned: 0 in 0.387s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:34 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000 Jul 17 07:19:34 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:34 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-00d14920-569e-4ea8-b92b-f6b6d3c5e000" returned: 0 in 0.250s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-00d14920-569e-4ea8-b92b-f6b6d3c5e000" released by "delete_volume" :: held 0.681s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Created reservations ['1c7364ae-8459-43d6-8278-f4c1aa5c3f8f', '7d95bef4-c62b-4dca-bbd0-c30a3aa7c8e3', '2a838951-596d-4cc0-a039-b2d1e7b7c688', '92410e97-14b8-4e2a-ad53-1ed63b24050e'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:34 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:34 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:34 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.243s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:34 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Deleted volume successfully. Jul 17 07:19:34 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-35b76052-2460-4b15-9cd3-f9dd22bc83a5 tempest-ProjectReaderTests-587791877 None] Lock "cinder-00d14920-569e-4ea8-b92b-f6b6d3c5e000-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (73546035-263c-40aa-987a-d9309fcd49d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f044b8-590d-4a7d-867c-9590e83fbc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f044b8-590d-4a7d-867c-9590e83fbc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139322507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9761be-899c-4631-aef8-0e2113781abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:35Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85eb2dc-53cd-4e24-8405-4b0ac088a4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85eb2dc-53cd-4e24-8405-4b0ac088a4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caae599-5313-4aa5-8e81-9c5811710465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caae599-5313-4aa5-8e81-9c5811710465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9761be-899c-4631-aef8-0e2113781abf', 'volume_name': 'volume-9b9761be-899c-4631-aef8-0e2113781abf', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90578b46-f392-49d2-9d80-09c3e878b498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90578b46-f392-49d2-9d80-09c3e878b498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d992ff0-08ba-46b8-89f7-f29053e19a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:35 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Volume 9b9761be-899c-4631-aef8-0e2113781abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9761be-899c-4631-aef8-0e2113781abf', 'volume_size': 1} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139322507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9761be-899c-4631-aef8-0e2113781abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:35Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Creating volume 9b9761be-899c-4631-aef8-0e2113781abf {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:35 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:35 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf 1073741824 Jul 17 07:19:35 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:35 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf 1073741824" returned: 0 in 0.474s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:35 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:36 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf Jul 17 07:19:36 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:36 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf" returned: 0 in 0.265s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d992ff0-08ba-46b8-89f7-f29053e19a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9761be-899c-4631-aef8-0e2113781abf', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cc557b-8f66-4a9e-b754-ea7704619dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:36 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Volume volume-9b9761be-899c-4631-aef8-0e2113781abf (9b9761be-899c-4631-aef8-0e2113781abf): created successfully Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cc557b-8f66-4a9e-b754-ea7704619dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:36 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (73546035-263c-40aa-987a-d9309fcd49d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:36 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-0ca01dbe-9ebc-4546-a1cb-03c7a4c9c156 tempest-ProjectReaderTests-587791877 None] Created volume successfully. Jul 17 07:19:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-9b9761be-899c-4631-aef8-0e2113781abf-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Lock "cinder-9b9761be-899c-4631-aef8-0e2113781abf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-quobyte-9b9761be-899c-4631-aef8-0e2113781abf" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:37 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-9b9761be-899c-4631-aef8-0e2113781abf" acquired by "delete_volume" :: waited 0.016s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:37 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a89b7d6-be68-4cf8-ba24-dc8d124cf011]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:37 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:37 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf Jul 17 07:19:37 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:38 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf" returned: 0 in 0.371s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:38 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf Jul 17 07:19:38 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:38 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-9b9761be-899c-4631-aef8-0e2113781abf" returned: 0 in 0.254s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-9b9761be-899c-4631-aef8-0e2113781abf" released by "delete_volume" :: held 0.666s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Created reservations ['397910de-a958-42d5-8f2f-20f021f5b600', '1a76c077-e9e1-45e9-bafe-3a086aa3ec2c', '97a9da0b-c4e3-4db8-9c44-b99cda1d8dcd', '0a0bfe8b-89cd-4e9a-aab6-e156dfa035d6'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:38 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:38 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:38 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.275s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:38 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Deleted volume successfully. Jul 17 07:19:38 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-024a330d-7aeb-4a9f-8705-dadfd481ccb7 tempest-ProjectReaderTests-587791877 None] Lock "cinder-9b9761be-899c-4631-aef8-0e2113781abf-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.flows.manager.create_volume [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87331) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (ea5616a4-780f-4800-930d-15415cc627b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a740b47c-33bf-41fc-9dea-19a362aafb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a740b47c-33bf-41fc-9dea-19a362aafb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788950024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead0a63f-c9d2-4b7b-b3f9-9e37903da348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:39Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963261f0-8f2a-4b3d-9a21-ae655bb5f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963261f0-8f2a-4b3d-9a21-ae655bb5f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b43c324-c2b2-40f9-addc-9caf44e2553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b43c324-c2b2-40f9-addc-9caf44e2553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead0a63f-c9d2-4b7b-b3f9-9e37903da348', 'volume_name': 'volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a69bd6-bc90-46ed-8961-1f37be2f811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a69bd6-bc90-46ed-8961-1f37be2f811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3d04bb-52e6-4847-b935-819c90209215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:39 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Volume ead0a63f-c9d2-4b7b-b3f9-9e37903da348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348', 'volume_size': 1} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-17T05:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788950024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead0a63f-c9d2-4b7b-b3f9-9e37903da348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8bb02a1d794f50bc53e6d1b9e44e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T05:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T05:19:39Z,use_quota=True,user_id='28d5842e5c1143a28d874a04253ecc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92448330-9da3-4a5a-a886-633a2942c352),volume_type_id=92448330-9da3-4a5a-a886-633a2942c352)}" {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.remotefs [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Creating volume ead0a63f-c9d2-4b7b-b3f9-9e37903da348 {{(pid=87331) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Selected osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 as target Quobyte volume. {{(pid=87331) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 17 07:19:39 devstack cinder-volume[87331]: INFO cinder.volume.drivers.remotefs [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] casted to osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004 Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 1073741824 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:39 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 1073741824 Jul 17 07:19:39 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:39 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 1073741824" returned: 0 in 0.476s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:39 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:39 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 Jul 17 07:19:39 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:40 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348" returned: 0 in 0.262s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'} {{(pid=87331) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3d04bb-52e6-4847-b935-819c90209215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348', 'volume_size': 1}' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4385d06-4e88-4521-ba4c-bb6e4d675d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 17 07:19:40 devstack cinder-volume[87331]: INFO cinder.volume.flows.manager.create_volume [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Volume volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 (ead0a63f-c9d2-4b7b-b3f9-9e37903da348): created successfully Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4385d06-4e88-4521-ba4c-bb6e4d675d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87331) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 17 07:19:40 devstack cinder-volume[87331]: DEBUG cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Flow 'volume_create_manager' (ea5616a4-780f-4800-930d-15415cc627b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87331) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 17 07:19:40 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-21dcccdc-a39b-4665-adf5-b393f55377b0 tempest-ProjectReaderTests-587791877 None] Created volume successfully. Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-ead0a63f-c9d2-4b7b-b3f9-9e37903da348-delete_volume" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Lock "cinder-ead0a63f-c9d2-4b7b-b3f9-9e37903da348-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Acquiring lock "cinder-quobyte-ead0a63f-c9d2-4b7b-b3f9-9e37903da348" by "delete_volume" {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-ead0a63f-c9d2-4b7b-b3f9-9e37903da348" acquired by "delete_volume" :: waited 0.034s {{(pid=87331) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca9555-e70b-489f-bf86-c6e3347ec1c6]: (4, 'qcow2') {{(pid=88551) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:41 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 Jul 17 07:19:41 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:41 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348" returned: 0 in 0.397s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:41 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:41 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348 Jul 17 07:19:41 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:42 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da/volume-ead0a63f-c9d2-4b7b-b3f9-9e37903da348" returned: 0 in 0.255s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Lock "cinder-quobyte-ead0a63f-c9d2-4b7b-b3f9-9e37903da348" released by "delete_volume" :: held 0.691s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG cinder.quota [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Created reservations ['3ab41961-6856-4540-9ec2-c839a9b7faf9', 'f32b3445-62d5-4c04-a81b-8b0cf4522493', 'bc3d2380-87a1-4a1b-ad13-a1d7851169ac', '6097278a-0518-453c-bd0a-272ad40ba090'] {{(pid=87331) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004': None} {{(pid=87331) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG cinder.volume.drivers.quobyte [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-967ca0f7-c40f-465d-ada1-2d51e81b5004'] {{(pid=87331) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.lockutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87331) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 17 07:19:42 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da Jul 17 07:19:42 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 17 07:19:42 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG oslo_concurrency.processutils [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c73854e6e4454354cad523b68d13d7da" returned: 0 in 0.256s {{(pid=87331) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG cinder.manager [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Notifying Schedulers of capabilities ... {{(pid=87331) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 17 07:19:42 devstack cinder-volume[87331]: INFO cinder.volume.manager [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Deleted volume successfully. Jul 17 07:19:42 devstack cinder-volume[87331]: DEBUG cinder.coordination [None req-c2833351-bd7b-4b22-9db5-fef6da4905fb tempest-ProjectReaderTests-587791877 None] Lock "cinder-ead0a63f-c9d2-4b7b-b3f9-9e37903da348-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87331) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 17 07:19:52 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:INSERT=32,cinder:UPDATE=105,cinder:SELECT=63,cinder:DELETE=10 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 17 07:19:52 devstack cinder-volume[87331]: DEBUG dbcounter [-] [87331] Writing DB stats cinder:DELETE=7,cinder:UPDATE=92,cinder:SELECT=71,cinder:INSERT=19 {{(pid=87331) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}